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ABSTRACT 


This roport summarizes research accomplishments achieved under NASA 
Grant NSG-1312. Robustness properties of sample-data LQ regulators are de- 
rived which show that these regulators have fundamentally inferior uncertainty 
tolerances when compared to their continuous-time counterparts. New results 
are also presented in stability theory, multivariable frequency domain 
analysis, LQG robustness, and mathematical representations of hybrid systems. 


TABLE OP CONTENTS 


SECTION PAGE 

1. INTRODUCTION I 

2. GENERALIZED STABILITY THEORY 3 

3. ROBUSTNESS GUARANTEES FOR SAMPLE DATA REGULATORS 11 

4. FREQUENCY DOMAIN INTERPRETATIONS 19 

5. SYSTEM SPECIFIC ROBUSTNESS PROPERTIES 23 

6. COMPENSATED SAMPLE-DATA FILTERS 25 

7. LQG ROBUSTNESS PROPERTIES 27 

8. HYBRID SYSTEM DESCRIPTIONS 31 

9. CONCLUSIONS 45 

REFERENCES 47 

APPENDIX A 
APPENDIX B 


APPENDIX C 


LIST OP FIGURES 


Figure No. 

Title 

Page 

1 

Safonov Stability Theory 

4 

2 

Sector of Stable State Feedback Systems 

14 

3 

Optimal Nyquist Diagram 

19 

4 

Typical Digitally-Implemented Control System 

34 

5 

Triangle Strip 

37 

6 

Opt imal Approximating Operator 

38 


1, INTRODUCTION 

Over the past several years, MIT's Laboratory for Information and Decision 
Systems (LIDS) has been conducting research for NASA on the properties of mul- 
tivariable digital control systems. Those typos of systems are becoming in- 
creasingly important as small, powerful, flight-qualified digital computers 
take over the burden of control law implementation in various NASA vehicles 
and other control system applications. Examples include the shuttle orbiter, 
the HIMAT and E-8C DFBW aircraft, satellites such as ATS-6, various proposed 
large space systems, and many more, 

The overall goal of the research program has been to evolve improved de- 
sign methods for multivariable digital control laws. Research effort was 
concentrated initially on the primary available synthesis tool — namely the 
sample-data (discrete-time) Linear-Quadratic (LQ) regulator problem [Athans, 

1], Various properties of this problem formulation were studied, and key 
features of its solution were investigated. In the latter category, the basic 
robustness properties of sample-data LQ solutions were studied under the spe- 
cific NASA research grant NSG-1312. Research findings attributable to this 
grant are summarized in this report. 

We will use the term "robustness" qualitatively to describe the ability 
of control system designs to maintain stability and performance in the face 
of plant uncertainties. The larger the level of uncertainties which can be 
tolerated, the more robust a design is considered to be. In real-life appli- 
cations, robustness properties are among the most important features of control 
designs. This is true whether the designs are achieved with classical or 
modern synthesis methods, and whether they are implemented in analog or 
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digital fashion, in each casq, the actual plant being controlled will invari- 
ably differ from the design model/ thus necessitating a healthy measure of 
uncertainty tolerance. Further discussion of engineering motivations for 
robustness can be found in a tutorial paper by Stein/ prepared in part under 
the NSG-1312 grant [2] . 

The report summarises our robustness research in the form of seven 
short topical sections. Each suction describes a major research area, briefly 
summarizes the principal findings and their significance, and cites published 
papers and/or appendices for further details, The major areas are the fol- 
lowing; 

Section 2 - Generalized Stability Theory 

Section 3 - Robustness Guarantees for Sample Data Regulators 
Section 4 - Frequency Domain interpretations 
Section 5 - System Specific Robustness Properties 
Section 6 - Compensated Sample-Data Filters 
Section 7 - LQG Robustness Properties 
Section 8 - Hybrid System Descriptions 
Three appendices are included to provide supporting details and derivations 
for topics where published manuscripts are not yet available. 


2. GENERALIZED STABILITY THEORY 


Since stability is the foremost essential feature of feedback systems, 
its robustness properties with respect to plant uncertainties received 
primary research investigation. The major theoretical tools used for these 
investigations include the classical Nyquist and Lyapunov stability theories 
as well as a more abstract and general interpretation of stability due to 
Safonov, The latter was developed in part under the. present grant. 


:abilit 


Topological Separation 


In Safonov's interpretation, the stability property of a feedback system 
is viewed in an abstract yet elegantly simple way. The system is stable if 
its feedback and feedforward elements are appropriately separated in the func- 
tion spaces on which they are defined. This notion is illustrated conceptually 
in Figure 1, Part A of this figure shows a standard feedback system with 
feedforward element G and feedback element H. These elements are viewed quite 
abstractly as "relations" between their respective input functions and output 
function. This simply means that if we let X and Y denote the function spaces 
to which the points (functions) x and ^ belong, then <3 and 5 are subsets of 
the Cartesian product X x y . Part B of Figure 1 shows this interpretation 
schematically. X is represented as the real line (one axis) , y is another 
real line (the second axis) , and X x V is the plane. G and H are then two 
subsets of the plane. 

It follows from this abstract view of G and H, that all solutions of 
their feedback interconnection in Part A must be common points of the two 
subsets in Part B. Moreover, if it is known that these two subsets are 
separated such that (in the absence of disturbances and initial conditions) 
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they only have zero functions in common, as represented by the point 
(0,0) e X x y, then the feedback system must be stable. 

This simple statement of separation is the essence of Safonov's stability 
theory. Formally, of course, the theory requires much more elaboration and 
mathematical machinery. The function spaces X and V must be extended 
inner product spaces, relations G and H must account for disturbances and 
initial conditions through functional dependences of their own, and the notion 
of separation must be properly quantified. These formal developments are car- 
ried out in Safonov's Ph.D. thesis (3, Fart 2] and in reference (4) . Only 
the major ideas needed to quantify separation are further discussed below. 

Separating Functionals, Sectors, and the Multivariable Circle Criterion 

The key idea which makes the above stability interpretation useful as a 
stability analysis tool is the concept of "separating functionals," These 
allow us to test whether the feedback system's elements indeed have only the 
origin in common. Very simply, a separating functional is any scalar valued 
function-of-functlons d(x,^) defined on the Cartesian product space X x V, 
whose sign separates this space into two regions, One region consists of 
all the points (pairs of functions) for which 

d(x, Z ) < 0 , (1) 

and the other region consists of points 

d(x,y.) > 0, (2) 

with d(x,yj « 0 obviously forming the boundary. In terms of such separating 
functionals, a feedback system is stable if its two elements £ and H satisfy 
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( 3 ) 


(i) d{x,y) > n(x,y) ' u 
for all (x,y) corresponding to 0, % ,»»u 

(ii) d(x,y) < 0 

(4) 

for all (x,y) corresponding to It. 


Her* n (x ,y) i* a positive definite radially unbounded scalar functional which 
i& imposed to ar sure a technical reejuiromant that the subsets in Figure 1 grow 
"sufficiently far apart" an x and/or y get large. 

Safonov has shown in [3} and [4] that the notion of stability as topologi- 
cal separation and established via separating functionals is quite general 
indeed. For example, the classical usability thoory of Lyapunov can be derived 
by appropriate choices of U. H and d[4). Similarly, the S1SO conic sector 
stability result of Karnes [ r >], and hence its corollaries — the Popov, circle, 
passivity, and small-gain -stability criteria — can also be derived from this 
perspective. In fact, Safonov has invented specific kinds of separating 
functionals which generalize Hama's concept of conic sectors and lead to a 
general multivariable version of the circle criterion. 

Safonov's generalized conic sectors, simply called "sectors," are defined 
to be regions of the space X x / which are based on the following specific 
separating functionals t 


g(x,y) a F(x,y) 


A 


F y + 


F X, 
~ 12 ~ 



(5) 


Here F^and are operators mapping V into a third function space Z, 

^ and F are operators mapping X into Z, and <•,*> denotes an inner product 
defined on Z. Then the "Sector of F" is the set of points (x,y) for which 
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£(x#l> < 0 . 


(6) 


It follows from our previous interpretation of stability that the feedback system 
of Figure 1 will be stable if the subset of points corresponding to £ is inside 
the sector of some functional £ while the subset of points corresponding to G 
is strictly outside that sector. Here the words "strictly outside" are used 
to imply the same kind in increasing separation with increasing x and/or v as 
was used in Condition (i) above, 

In terms of this definition, the SISO conic sectors of Zames are simply 
the sectors of special functionals F in the form 


-11 

12 



F.. » 1 
~21 


- (c + r) 

- (c - r) 



(7) 


where c and r are scalars called the "canter" and "radius" of the conic sector, 
respectively. These types of regions were used by Zames [5] to establish 
stability conditions which include the circle criterion [6] as a special case. 

The more general sectors were used by Safonov in [4] and [7] to prove a more 
general multivariable version of the circle criterion. 

Without going into the derivations or formality in detail, the multivariable 
circle criterion was developed for a linear dynamic operator as the feedforward 
element, G, and a nonlinear dynamic operator as the feedback element, Jtf. Sup- 
pose H lies inside the generalized conic sector defined by 

F (x,^.) « <y - Cx - Rx, y - Cx + ,Rx> (8) 
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l.e. # • £ 2l • I# , ■ -£ •£ and whero the multivariable 

center and radius, C and £, are themselvo* linear dynamic operators, and where 
<*,*> denotes the standard inn'-*' product on extended L. function space (i.e., 

a r T t 

<a,b> ■ / a (t)b(t)dt, Vr ) . Then, according to tho topological separation 

concept, the feedback system will be stable if all points corr*s|x>ndlng to G 
fall outside the sector of F, or equivalently, if for all points x ■ ^ w« have 

0 < Hx.^) ■ - w fT v , ^ - r p V ♦ Jj^> 

• I! (i - c^Jzll 2 - I l-es£v 1 1 2 

Usinq Parsoval's theorem, the last expression can be transformed into the 
frequency domain to get the following sufficient stability criterion i 

0 < |I - CG(-ju>) ] T 1 1 - CG ( jw) ) - RG(-ju>) T RG(jw) for all ui (10) 

As a technical detail, it should be noted that tho application of Parseval'a 
theorem in the last stop requires that the systems defined by transfer functions 
G ( I - CG) * and P must be themselves stable. This can be established by a 
separate Nyquist encirclement count or by explicit calculation of roots. For 
the sector radius, jR, stability is usually imjosed by assumption. Further 
details and other equivalent forms of (10) can be found in Safonov's thesis 
(3] and in tho c »fonov/Athans paper (7). It is i articular ly interesting to 
note that (10) can b< expressed in terms of singular values to get the stability 
robustness conditions of Doyle (13). 

Some Comments on Sign ificance 

Aside from the obvious significance of the above results as a "global" 
theory encompassing various previous stability results as special cases, the 
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topological separation and sector concopts of Safonov have two specific fea- 
tures which roako them invaluable for the research objectives of the current 
study. First, the abstract treatment of the two elements G and H makes no 
assumption about the underlying nature of these relations, e.g., whether they 
represent continuous or discrete devices. Hence, the stability results apply 
equally well to analog and digital control system analysis. Second, by their 
very nature, the results face up to the robustness equations. Stability is 
not assessed for specific system elements G and H but for a whole class of 
elements covered by the possible points within a sector. A feedback system 
which is stable for nominal elements H. e Sector (F) , G* e Sector (F)"^” will 
remain stable for all perturbed elements H within that sector. Hence, the 

#v 

"size" of the sector, as measured, for example, by the magnitude of its 
radius, R, becomes an immediate indicator of the degree of robustness of the 
system. The utility of both of these features becomes evident below. 
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3. ROBUSTNESS GUARANTEES FOR SAMPLE DATA REGULATORS 


For the research objectives of the NSG-1312 grant, we are specifically 
interested in discrete time or sample data representations of linear dynamic 
systems in the following form: 


*k + l = **k + Bu k 


\ - - Gx k <12) 

Here x^ denotes the usual n-dimensional state vector corresponding to continuous 
system states sampled at discrete instants of time, u^ is an m-vector of controls 
which is constant over each sample interval, and A, B, G are matrices of appro- 
priate dimension. We assume that the feedback gain G is obtained by solving 
a sample-data linear-quadratic regulator problem, and that it therefore satis- 
fies the well known discrete time Riccati equations [1] : 

G - (R + B T KB) -1 B T KA (13) 


K = (A - BG) T K(A - BG) + Q + G T RG . 


Under mild assumptions on A, B, Q and R, the resulting closed loop system is, 
of course, stable and can be made to exhibit desirable dynamic properties through 
appropriate manipulations of Q and R. The research question at hand is to quan- 
tify the extent to which these properties — stability in particular — will 
be maintained as the true system description in (11) - (12) deviates from the 
design model used to compute G in (13) - (14) . 

The stability theory summarized in Section 2 proves ideally suited to this 
research task. We note first that equations (11) - (12) provide very specific 


r'ttc&tUiftG PAtifc bLArtK NOT 
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forms for the general input-output relations 5, ii considered earlier. The 

«v tv 

feedforward relation, 5, for instance, can be taken to be the (nominally) ' 
algebraic map 


x ** Gy 

* (A - BG)X 

and H can be taken as a multivariable delay operator 


( 15 ) 


» IIX 

« ^Y k+ i “ x k ? k “ 0,1,..., with y Q « 0} 


(16) 


Both are operators on the (extended) function space of n-dimensional sequences 
with inner product 

T 


<*0?T * £ x k Y k V T 
k»i 


(17) 


Using (17) in Safonov's definition of sectors, it is then a simple matter to 
show that the points (pairs of sequences) corresponding to H fall into sectors 

*v 

defined by 


£‘(x,y.) « <P l/2 y_ - P 1/2 x, p 1/2 y_ + p 1/,2 x> 

I/O 

for any positive definite symmetric matrix P . This is true because (18) 
evaluated at points satisfying (16) becomes 

w ■ & *h**i-i - £a* i 

A »1 1“1 


(18) 


-x px <0 v r 

T T ~ 


(19) 


It then follows immediately that the feedback system (11) - (12) will bo stable 


12 


whenever the sequences (x,y) corresponding to (lli) fall strictly outside the 
sector defined by (18) . The entire complement of Sector (P) thus forms the 
permissible range of plant variations which do not compromise stability. 


Robustness of State Feedback 




The above observations load to the following fundamental result on the 

inherent robustness of sample-data state food jack: 

Let G be an arbitrary state feedback gain matrix which stabilizes 
the nominal design model (i.e., A - BG is stable). Define P to be 
the solution of the following steady state Lyapunov equation 

P « (A - BG) T P(A - BG) + S , S * S T > 0 (20) 

Then the feedback system (11) - (12) remains stable for all perturbed 
systems $ - BG, where A and § are perturbed matrices or even non- 
linear dynamic operators, provided that the points (v,w) corresponding 
to 

W « P 1//2 (A - BG) V (21) 

fall strictly inside the conic sector 

P (v, w) = <w - P^^v, w + P^ 2 v> (22) 

More simply, the system remains stable whenever the perturbed system 
matrix pV"2 _ bg) lies within the bounds IP 1 ' . This is illustrated 
schematically in Figure 2. 


To prove this result, it is only necessary to show that the sector conditions 
(21) - (22) imply that all points (x,y) corresponding to A - BG are strictly 
outside some sector of the form (18). To do this, we note that in the feedback 

interconnection of G and H, the input of G corresponds to y = v and the output 

_ - 1/2 
of G corresponds to x E P w. Then 

<w - P 1/2 V, w + P 1/2 V> < 0 


v ,_,l/2 _l/2 _l/2 , _l/2 . . - 

=> <P >c - P y, P x + P y> <_ 0 


*> < P V2 Z _ p l/2^ p l/2 x + p l/2 x> > 0 


Q.E.D. 
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This is strictly a formal development, of course. A rigorous proof again re- 
quires the mathematics of extended function spaces, operators which are func- 
tionally dependent on disturbances, etc. Such proofs are developed in detail 
in Safonov's thesis [3, Part IV]. 

Robus t ness of Optimal Regulators 

The above robustness result for sample-data state feedback applies directly 
to optimal regulators as well because these are known to satisfy the Riccati 
equation (14) . Note that with G fixed, this equation is a Lyapunov equation 
like (20) with a specific choice of S. Hence, we can conclude directly that 
the LQ-regulator (11) - (12) remains stable for all perturbed operators A - BG 

«V 

such that 


F(w,v) = < w - K 1//2 v, w + K 1(/2 v> < 0 

1/2 

for all points (w,v) such that w = K (A - BG) v 


(23) 


Here again, the perturbed system A - BG can consist of perturbed matrices A and 

K» ««* 

B,\^or the matrices may themselves be nonlinear dynamic operators. This is 
evidently a very general robustness condition with various special applications = 


Gain and Phase Margins 

Two particularly meaningful applications concern the regulator's robust- 
ness with respect to specific perturbations such as gain changes, phase changer-, 
or nonlinearities in the control channels. These manifest themselves as per- 
turbed operators of the form 


A - BG » A - BNG (24) 


Where N is a m x m nonlinear dynamic system nominally equal to identity. If we 
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assume that N and the weighting matrix, R in (13) are both diagonal, then it 
is shown in 13) that the robustness condition (23) is satisfied whenever all 
diagonal elements of N satisfy 


■ %. - <c i + r i>V Si ' (o i + W i 0 

1 


for c. * 
1 


1 - al 


r i " 


1 - a? 

l 


a. » Jr. ./[r. , + X (B T KB)] 
i T ii n max 


and all (w.,v.) such that w, * N. ,v. 
*~*1 


(25) 


This condition requires that the points of each N, . must lie in a conic 

~xx 

sector with center c^ and radius r^, both defined by the weighting matrix 

elements R^ and by the Riccati matrix K. If is a pure algebraic gain or 

algebraic nonlinearity, for example, this requires that 

N. . (v, ) 

. li k' 

c . - r , < < c , * r . 

x x - v, - x x 


1 < N i.i ( V < 


X + a. 
x 


1 a. 

i 


(26) 


for all k « I/ 2 #.*. Likewise, if is a stable linear dynamic system, say 

L, , then we must have 
* w 


< l h - °i^i - E iV ( h 


c i^i * Vi* 1 0 



<_ 



2 


*> 1 1 (I^tc^) - oj 1 2 < rj V to 


(27) 


where L. (z) is the z-transform of the operator In , This constraint confines 
(z) , when evaluated at z « e^ w \ to lie within a circle with center c^ and ra- 
dius r^. Given that L^(z) is nominally unity, it can therefore be perturbed 
in pure gain from c i - r^ * l/(l+a^) to c^ + r^ * l/(ira^) and is pure phase 
by 


j<j>| < 2 sin” 1 (a i /2) 


(26) 


These then are the guaranteed gain and phase margins of the sample-data regu- 
lator. Note that they apply individually or in any combination to the m con- 
trol channels. 

Significance 

The significance of the above margins can be be appreciated by noting that 

the scalars a^ in (25) - (27) are approximately unity. Their deviation from 

T 

1.0 is controlled by the quantity X (B KB) in (26) which is known to tend 

max 

to zero as sample intervals A tend to zero (B •* 0 while K -+• const) . Hence 
the a^ ' s approach unity from below and 

Gain Margins ->• 1/2 to 
Phase Margins -* ±60 deg. 
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These limits are precisely the stability margins enjoyed by the continuous time 
linear-quadratic regulator [8] . The sample-data regulator, however, achieves 
these margins only asymptotically as sample rates get large. For all finite 
rates, it has fundamentally poorer margins. 

A second important distinction between sample-data and continuous-time mar- 
gins is that the latter are independent of plant and cost matrices. They are 
a consequence of optimality alone. In the sample data case, the parameters 
depend on plant data (through R and B KB) and hence the margins are no longer 
global plant-independent guarantees. 

Similar results as these apply to sample-data Kalman filters and to non- 
linear systems linearized about various operating points (x,^) as well. These 
additional results of the NSG-1312 grant are fully developed in Reference [3], 
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4 • FREQUENCY DOMAIN INTERPRETATIONS 


Both tha continuous time margins in f 8] and the sample data margins above 
were developed with relatively sophisticated mathematical machinery. This tends 
to make the results loss accessible to practicing engineers than desirable. 

To overcome this problem, wo have attempted under NSG-1312 to develop simple 
frequency domain explanations. These have proven quite useful in communicating 
the results and are briefly summarized below. 

The Continuous-Time Case 

The robustness juroperties of LQ-regulators can be viewed as multivariable 

generalizations of single-input frequency domain results dating back to Kalman. 

For the single-input case, Kalman proved that the return difference 
A t -1 

T(s) * 1 + g (si -A) b of an optimal controller satisfies [93 

|T(jW)| 2 >l (29) 

A T -X 

at all frequencies, to. Hence, the loop transfer function G Q (s) * g (si - A) b 
lies outside of a unit circle centered at (-l,jO) in the complex plane. This 
is illustrated in Figure 3 below; 
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The (-6 to + <» db) -gain and +60 degree phaen tolerance* then follow from the 
Nyquiat Stability Theorem applied to this geometry. Recall that the nominal 
system ia stable. Hence, its encirclement count of the (-1/0) point is correct 
and will remain correct for all perturbations G * G Q + eSG which do not cause 
the now Nyquiat diagram to pass through (-1,0) for some 0 < e < » , If we 
consider perturbations which are pure gain changes only, for example, then 
G « £Gq and it is clear that the system remains stable for all e, except when 
G q falls on the real axis for some w, i.e., Gq •• -a + jO. In that case, the 
tolerable e range is — < e <». since a is guaranteed to be greater than or 
equal to 2.0 (Point A), the gain margin result follows. Similarly, if we 
consider pure phase changes such that G ■ a- ,e G 0 it follows that the system re- 
mains stable for all e unless J 0 Q J ■» 1. In that ease, the Points B and B' are 
the worst locations for G Q and the ±60 deg. phase margin property follows. 

In terms of the multivariable generalization, it can be shown that the 
matrix version of the optimal return difference also satisfies an inequality, 
namely 

[I + G' (~jO))] T [I + G' (j0J) J > I (30) 

This inequality implies that the loop transfer matrix G' (s) = R 1//2 G(s)R _1//2 
lies outside of a unit ball centered at (-I,j0) in the m-dimensional space of 
complex numbers. The (-6 to + » db)-gain or ±60 degree phase tolerances for 
each control channel then follow from the geometry of this ball. We again in- 
voke Nyguist's Stability Theorem which now requires that the function 
dot [I + G'(jw)] encircle the origin a requisite number of times. This number 
is correct for the nominal system and will remain correct as long as I + G' (jw) 
remains nonsingular. This is assured as long as 
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(I + <3* )v f 0 (31) 

for all unit vac tors v. However, from (30), we have that 

| (X + G')v| > ] v j (32) 

This means that G'v lies outside of a ball centered at ~v with radius | v | * 
Projected onto any plane, the geometry of this ball looks just like Figure 3 
and hence the allowable perturbations in G' follow from the same geometric 
arguments . 

The Discrete Time Case 

The analogous property to (29) for optimal sample data systems is 

|l + GU) | 2 > t s - e' Jt0 \ (33) 

r+b Kb 

where r is the (scalar) control weight, K is the Riccati 
matrix and A is sample time. 

This condition implies that G(z), like G(s), lies outside of a circle centered 

A fp T/2 

at (-1, jO) , but with radius y « [r/(r+b Kb)] less than unity. Hence, from 
the Nyquist stability Theorem and the geometry of this smaller circle, it is 
clear that gain increases by factors greater than 1/ (1-y ) , gain decreases by 
factors greater than l/(l+y), or phase changes less than ±60 degrees could 
produce instability. Moreover, the radius parameter y , and hence the margins, 
are plant-specific because they depend on K and b. 

This same argument carries over to multivariable problems where the return 
difference can be shown to satisfy 
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) 


(34) 


(i + + g'uh > r“ 1/2 r r~ 1/2 

With R * R + 0 T KB 

and G' (z) » R 1/2 ti(z) R~ 1/2 , 


z » a 


jWT 


Hare the loop transfer function G' (z) is seen to lie outside of an ’'ellipsoidal 
ball" with minimum radius 

14 - lX min (R" 1/2 R r" 1/2 )1 1/2 

less than unity. As above , the margin properties follow from the geometry of 
this ball. 

As in Section 3, the radius of the ball above is seen to approach unity 
as B KB approaches zero. Hence, the continuous time margins and plant inde- 
pendent robustness guarantees are recovered asymptotically as sample rates 
tend to infinity. 


5. SYSTEM SPECIFIC ROBUSTNESS PROPERTIES 


As w# observed above, the robustness properties of continuous time LQ- 
regulatora are quite profound theoretically. They hold with no mention of 
the actual plant being controlled or its performance index. The margins are 
a consequence of optimality alone t All that is needed are the usual existence 
and uniqueness assumptions for LQ controls. Moreover, we have shown by counter 
examples that the margins are the broadest which can be achieved without 
further reference to particular system characteristics [10] . 

These observations do not mean, of course, that it is useless to look for 
broader plant-specific tolerance bounds. In many design problems, for example, 
it may well be important to increase the 50% gain reduction tolerance (-6 db) 
all the way to 100% (i.e. open loop) in order to achieve system reliability, 
Results which indicate that this is possible for specific problems have been 
derived by Wong, Athans and Stein [10] in part under the NSG-1312 grant. A 
particular result from [10] is that tolerable gain reductions can be bounded by 

A > 1/2 [I - r 1/2 g T q -1 gr 1/2]-1 (s invertible) ( 35) 

where A » diag (Y^, is a diagonal pure gain perturbation in the control 

channels. 

In specific examples, these lower bounds have been shown to be equal to 
the system's linear critical gain, which means that they achieve the broadest 
tolerance region possible for the example. Note that the bounds also provide, 
for the first time, an explicit relationship between gain margins and quadratic 
weights. 

Analogous plant-specific robustness properties for discrete-time systems 


ware developed wholly under NSG-1312 and are documented in detail in a draft 
manuscript included Appendix A. 


6 . 


COMPENSATED SAMPLE-DATA FILTERS 


We remarked in Section 3 that the robustness results achieved via Safonov 
stability theory apply to Kalman filter designs as well as to regulators. This 
connection is explored fully in [3] . Under NSG-1312 we also explored ways to 
enhance the resulting inherent filter robustness by dynamically compensating 
the filters so as to remove estimation biases. The details of this work are 
reported in a paper by Lee and Athans (11] . 

The basic premise of this paper is that the residual process of a discrete- 
time filter will exhibit low frequency biases whonever modeling errors and 
slowly varying inputs are present simultaneously. These biases can be modeled 
approximately as random walk processes. They can be observed by monitoring the 
residuals, and hence, they can be estimated by an auxiliary filter which uses 
the residuals as its "measurement" sequence. When the auxiliary and original 
filters are combined, they generate a 2n + m dimensional composite system which 
is effectively immune to unmodeled low frequency error mechanisms. Derivations 
and examples of this compensation procedure are given in [11]. 


7. 


LOG ROBUSTNESS PROPERTIES 


As discussed in Sections 3 and 4, our robustness results for sample-data 
LQ regulators show that the very act of sampling seems to impose a loss of 
uncertainty tolerance (less gain margin, less phase margin, etc.) when compared 
With continuous time LQ- regulators. This "loss of robustness" in discrete 
regulators is also exhibited by continuous time regulators with state estima- 
tion. Hence, the possibility that there may exist common underlying reasons 
or at least useful interrelations between these two phenomena motivated 
further studies of the LQG continuous time case. 

Results of these further studies are described in detail in a draft manu- 
script included in Appendix B. Highlights of these results are briefly reviewed 
here. First, the most basic discovery is that LQG-regulators have no guaranteed 
uncertainty tolerances whatsoever. This was established directly by a small 
design example due to Doyle [12] which produces a technically legitimate LQG- 
regulator with arbitrarily small tolerance for gain uncertainty (gain perturba- 
tion of ± e, with e arbitrarily small, cause instability). The main signifi- 
cance of this example is that it shows LQG robustness to be a design-specific 
property. For the research effort, it meant that instead of looking for 
global guarantees, we should seek out generic design situations in which 
tolerances are likely to be good or poor. For the latter, we should devise 
adjustment procedures to improve robustness. The following results along 
these lines have been developed. 

1. Margin recovery with "adapted Kalman filters" 

If the Kalman filter in an LQG-implementation receives the 
correct control signal (e.g., as altered by gain uncertainties) 
the LQG controller has gain margins equivalent to the full 
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state ease. This result is stated and proven as Proposition 
1 in Appendix B. It is also proven in a more abstract setting 
in (31. 

2 • Asymptotic Margin Recovery I 

Pull-state gain margins can be recovered asymptotically as 
the following ratio tends to infinity: 


min -x T (A+H C T )x 
T 

X Xs»l 

m 

max -x ( A+BGq)x 
T i 

X X-l 


(36) 


Here, A,B,C are the system dynamics, input and output matrices, 
and Gq and H Q are the controller and filter gain matrices re- 
spectively. 

3. Asymptotic Margin Recover II 

Full-state gain margins can be recovered asymptotically if 
the process noise covariance, $, in the Kalman filter design 
tends to infinity in the following special manner: 

4> -*• (j^BB^, (j>2 ra (37) 

Here <J> 2 denotes a scalar. 

The two asymptotic recovery results are stated and proven as 
Propositions 2 and 4 in the appendix. They serve the important 
function of providing ways to adjust 1QG design parameters in 
design situations where nominal model-motivated parameters pro- 
duce excessively sensitive controllers. 

4. General Gain Margin Bounds 

TjQG systems are stable for the following range of control 
gain variations: 



with X I < A < X , I 

~ T 

X + £ 1 + 1/*^ 

X = max[l-l/x , 1/X ] (39) 

~ 0 T 

Here A is a diagonal matrix, (il^ > 0 is a scalar which can be 
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made small by proper selection of design parameters, x Q > 0 
is a scalar which can be brought close to unity. Hence, this 
result also provides a systematic way to improve gain margins 
of an LQG~design. It is stated and pr^en as Proposition 3. 


More detailed statements, proofs, and discussions of these results are 
provided in Appendix B, In addition, further research directions are also 
outlined there which are worthy of continued research effort. 


8. HYBRID SYSTEM DESCRIPTIONS 


We have now seen that sample data LQ-regulators are fundamentally inferior 
to their continuous-time counterparts in the sense that their robustness 
properties are not as good. They share this inferiority to some extent with 
continuous LQG regulators* but the latter can recover their robustness losses 
at least asymptotically by appropriate filter redesign. The only way that 
sample-data regulators can recover these losses is apparently to increase the 
sample rate arbitrarily. 

Motivated by these apparent limitations of the existing sample data LQ 
synthesis methodology, the research effort under NSG-1312 was re-directed 
toward more fundamental issues of digitally-implemented control systems. The 
first task of the redirected effort was to find a mathematical representation 
which properly captures both the continuous-time (analog) and the discrete- 
time (digital) processes which occur side by side in a digital control system. 
Such a representation was developed in what we call the "hybrid operator 
model" of the control process. This model provides an analog input-output 
view of the control process which explicitly includes sampling operations, 
digital calculations, hold operations, and continuous plant evolutions. The 
structure of this operator is summarized briefly below and in more detail in 
Appendix C. The latter is a draft manuscript of A. Kostovetsky' s Master's 
thesis prepared under the research grant. 

An immediate application of the hybrid operator is to explain the common 
use of prefilters in practical digital control systems. Simple norm calcula- 
tions in Appendix C show that the hybrid operator will have unbounded gain (in 
an appropriate function space sense) as the sampling process tends toward the 
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ideal impulsive sampling normally assumed in sample-data theory. Physically! 
this means that it provides arbitrary amplification for certain inputs (e.g., 
noise). Non- impulsive sampling, as obtained with pre-filters, bounds this 
amplification. 

The second task of the redirected research made use of the hybrid opera- 
tor model to answer the following very basic approximation question: How well 

can digitally- implemented control laws mimic analog ones? More specifically, 
if samplers, holds and digital algorithms are all selected to best approximate 
a given linear, time-invariant analog system, how good can the approximation 
be? The answer to this question is elegantly simple and profound. The digitally- 
implemented system can exactly duplicate the impulse response matrix, G(t-0), 
of the analog system at all points in the t, 0-plane except on a strip of width 
T (sample time) along the main diagonal (t=0). Inside this strip, the hybrid 
system's impulse response must be zero on various triangular segments. We have 
accordingly named this region of approximation the "triangle strip." Details 
of the optimal sampling, hold, and digital function for this approximation are 
again summarized below and derived in detail in Appendix C. 

The significance of the above approximation result is that it provides a 
simple and clear picture of the basic limitations inherent in digitally- 
implemented controls. Such controls are fundamentally inferior to their 
analog counterparts because they cannot utilize all the input data in the 
triangle strip. This limits bandwidth, restricts performance, and precludes 
robustness guarantees such as those enjoyed by the continuous- time LQ regulator. 
The precise quantitative way in which these limitations manifest themselves, 
however, is not yet understood and provides basic motivation for continued 
research efforts. 
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Hybrid Systems 


We will consider digital control systems which can be represented by the 
block diagram of Figure 4. The three main functions associated with the con- 


troller block in this diagram are: 

1. The sampling operation which converts M-dimensional analog 
inputs u(t) on the interval (&-l)T<t<&T into N-dimensional 
discrete samples , A*l,2, . . . , 


2. the digital algorithm which converts the N-dimensional se- 
quences into L-dimensional sequences r) k # k=0 , 1 , . . . , and 


3, the hold operation which converts the L-dimensional sequences 
ri k into k-dimensional analog functions v(t) on the interval 
kx<t<jk+l)T. 


The system's sample time will be designated by the symbol T. These three 
functions will be assumed to have the forms 


c At 

r At 


/ f (9)u(0)d0 - 

/ f n (0-AT)u(0)d0 

(40) 

U-l) A 

J (H) 0 


k. 



(41) 


v(t) = g k (t)n k = g 0 (t-k T )n k < 42 > 

The first of these equations is a simple analog convolution operation with 
weighting function (impulse response) f ^ (X ) . This could be the weighting 
function of an analog prefilter, an approximate impulsive sample, or various 
other vector valued input averaging operations. Some examples are given in 
Appendix C. The second equation is a standard digital convolution with coef- 
ficients . The third is a generalized output hold operation with weighting 
function (X ) • This could be a simple constant to represent the common 
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"zero-order-hold," but in general it will be selected to achieve broader goals. 
Some examples are again given in the appendix. Note that the controller is 
completely characterized by the two matrix-valued functions f Q (X ) , 9 q(M sod 
by the coefficient matrices D^. 

Hybrid Operator Representation 

Given the above description of a digitally- implemented controller, it is 
straightforward (Appendix C, Section 2) to write its input-output operator 
representation, G, in the terms of an impulse response matrix, G(t,0). That is, 

#v 


Gu 


(43) 


where v, and u denotes functions on [0, 00 ) related by the convolution 

-t 
K 0 

with 


v(t) “ f G(t,0)u(0)d0 


(44) 


G(t,0) - g Q (t-kT) £ D kX, f o (0 " AT) 
ft=l 


(45) 


Here k is understood to be the largest integer less than or equal to t/r. We 
will refer to this input-output description of the controller as "the hybrid 
operator model" or simply as the "hybrid controller." Note that it is a time- 
varying linear dynamic system characterized by g^, f^, and D^. 

Optimal Hybrid Approximation 

Consider now the problem of finding a hybrid operator model G (g^, 
to approximate a continuous- time linear dynamic control law with impulse response 


matrix 


G(t,0) 


Co Mt " 9) B 


( 46 ) 


where A,B, and C are given system matrices, 

Let the approximation criterion be to minimize 



v(t) | | 2 at 


I 

1 


( 47 ) 


where v(t) and v(t) are the outputs of the hybrid and pure analog controllers 
respectively, when excited by the same white noise input. Then it is shown in 
Appendix C, Section 4, that the optimal approximating hybrid controller has 
the following sampling function: 


f Q (\ ) * e~^B 

Its corresponding hold function is 


( 48 ) 


g Q (X) ** Ce M 


( 49 ) 


and the digital algorithm is 




- v* 


AT (k-&) 


(50) 


Moreover, these parameters cause (40) to duplicate (46) exactly everywhere ex- 
cept on the "triangle strip" of Figure 5. Note that the sampling and hold 
functions (48) - (49) of this optimal hybrid approximation are themselves 
n-fch order dynamic systems, where n is the dimension of A. Hence, the overall 
hybrid controller can be visualized as shown in Figure 6. 

As indicated earlier, the significance of the above result is not the op- 
timal structure in Figure 6 itself (after all, the sampling and hold functions 
are quite complex, each literally duplicating the analog system) , but rather 
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the fact that tho inherent hybrid system limitation* are *o simply and clearly 
displayed by the triangle strip in Figure 5. It follows from this figure that 
tho minimum approximation error is given by the error operator 


e » (G-$)u 


(51) 


where G-(a has the Impulse response representation 


e(t) « f 5 (t-0 ) u (0 ) dO 

‘kt 


(52) 


Qualitatively therefore# the hybrid system suffers an inherent time varying 
"data lapse" with a maximum duration of t seconds (average T/2), and with data 
weighting propoertional to the desired impulse response, G. Hence, both the 
nominal function G and the sample time t contribute to the significance of 
the error. Small errors are assured if G (X ) is small over the whole interval 
0 <t<t and u(0) is relatively "smooth." These observations are given further 
interpretation later. 


Extensions and Applications 

Two additional research results are developed in Appendix C which demon- 
strate the utility of the hybrid operator model. One result deals with con- 
strained optimization of criterion (47), subject to fixed sample and hold struc- 
tures, and the second deals with error bounds for expression (51) . 


Constrained Optimization 

This result provides optimal approximating hybrid operators which best 
match a given analog system when the sampling and/or hold circuits are pre- 
specified to take certain (simple) fixed forms. The major results are as 
follows : 
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G(t,0) ■ H (t) S (9 ) 


(53) 


Let 


with either 

(i) 

H(tj+t 2 ) « Hft^Mttj) 

or 



(ii) 

s(ti+t 2 ) “ 3(^)8 (t 2 ) 


(54) 


Fixed Sampler Result (using property (i))s 
f Q (X ) given, yields 
g Q (X ) = H (X ) and 
° k £ = M (kx ) d^ with 

a [j° §(X+T)l)f o (X)dX ][/ f 0 (X) 

-T “ T 

Fixed Hold Result (using property ii) : 
g Q (X) given, yields 

f Q (X) = S(X) and 
D ki = M k^ (T,t) with 

Fixed Sampler and Fixed Hold Result ; 
f 0 CX), 9 q(X) both given, yields 
D ki = w; *- th \ and '- s defined in (16) and (17) (57) 

These expressions define optimal digital algorithms and sample or hold functions 


f q (X ) dX 


-1 


(55) 


H(X+kT)dX 


(56) 
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under various fixed structure assumptions. In general, their approximation 
errors will no longer be zero outside the triangle strip. The nature and 
significance of these added errors remain to be evaluated. 


An interesting application of formulas (55) is carried out in Appendix A 
for the desired nominal system 

G(t,0) « e A(t-0) = ( e At ) (e “ A0 ) (5E 

with a fixed, nearly impulsive sampling operation 


f 0 <*> = 


-e<X<0 


elsewhere 


The optimal hold is found to be 


9 0 (X> = e 


and the corresponding digital algorithm is 


-»/V 


The fact to note here is that tends to zero as e becomes small. This is 
counterintuitive, at first, until we recall that impulsive sampling yields in- 
finite function space norms, must tend to zero in order to preserve a 

finite-gain hybrid approximation of G. This again highlights the weaknesses 
associated with pure sample data system representation and with impulsive 
sampling assumptions. 


Error Bounds 

The second additional line of research in Appendix C deals with bounds 
for the inherent approximation errors of the optimal hybrid operator in Figure 6. 
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I 

This research is motivated by the practical desire to include hybrid operators 
within the class of systems which can be handled by the stability robustness 
theory of Safonov, Doyle, Sandell, and Stein [3,13,14,15] . One of the basic 
results of this theory is the following: A nominally stable feedback system 
with nominal return difference operator I + G remains stable under additive 

'V 

perturbations G + AG if the perturbations satisfy [14] 

||U4G)" 1 || I I AO I I < 1 (62) 

This is a special version of equation (9) in Section 2. If G and AG are time 

** ise 

invariant linear systems with transfer functions G(s) and Ag(s), condition (62) 
is also often written in the form [16] 

a[l+G(jw)] < a[AG(jw)] for all w (63) 

where o and a denote maximum and minimum singular values of their respective 
matrices. 

These stability-robustness results are relevant to our present study of 
hybrid systems because they provide a way to assess the consequences of hybrid 
approximation errors, Specifically, if we think, of G as 8 (the nominal analog 

* *v 

system being approximated) and AG as the approximation error operator due to 
digital implementation, (equation (51)) then (62) and (63) provide a way to 
assess the Impact of hybrid approximations on the stability property. In this 
sense, hybrid errors play exactly the same role as other uncertainties which 
are associated with the nominal analog system. In fact, if other uncertainties 
are "large" compared with AG of (51), then the internal digital nature of the 
hybrid controller becomes inconsequential. Moreover, it should then be pos- 
sible to relax (simplify) some of its parameters (samplers, holds, sample rates, 
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etc.) at the expense of increasing AG, Clearly, simple tight bounds for | |AG| | 
will play a critical role in making these analyses and simplifications possible. 

To date, only the following conservative bound is available for AG 
(Appendix C, Section 5) : 

j | AG | | < max a[G(0)]T (64) 

~ ~ 0<Q<t 

This bound is merely the maximum singular value of G(t-0) on the interval 
kT<0<t, scaled by t. The T-dependencc makes it immediately useful as- a coarse 
selection criterion for maximum tolerable sample periods. It tends to be con- 
servative, however. A third order hybrid controller illustration in Appendix C, 
for example, violates (62) with (64) at T=0.36 sec. Actual instability does not 
occur until T reaches 0.54 sec. Another limitation of (64) is that it does not 
provide frequency dependent bounds for use in (63) . Much tighter bounds should 
be possible if the frequency content of signals is taken into account. This 
question forms an important area for future research. 


9. 


CONCLUSIONS 


This report has summarized research accomplishments achieved under NASA 
Research Grant NSG-1312, The overall objectives of this research were to 
analyze the basic robustness properties of linear-quadratic sample-data regu- 
lators and to explore the suitability of these regulators as tools for digital 
control system design. 

The major conclusion of the research is that sample-data LQ regulators 
are fundamentally inferior to their continuous time counterparts in the sense 
that their robustness properties are not as good. They share this limitation 
with continuous LQG designs. In both cases, however, the continuous time 
properties can be recovered asymptotically by increasing sample rates and by 
filter redesign, respectively. The research also accomplished important new 
developments in stability theory, multivariable frequency domain analysis, and 
mathematical representation of digitally implemented (hybrid) control systems. 
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APPENDIX A 


ROBUSTNESS OP LQ-OPTIMAL SAMPLED-DATA CONTROL SYSTEM; 

A SUMMARY OF NEW RESULTS 

P. K. Wong 
M. Athans 

This appendix presents the discrete time version of the continuous-time 
feedback robustness results for LQ-design reported in [10] (Theorems 1 and 2) 
and documents a new result for robustness of sampled-data control systems 
under L(2~design to changes in the sampling rate (Theorem 3) . 


A. Sampled-data System 

Given the system x - Ax + Bu 


x e 3R n 

_ _m 
u e ]R 


We have the following sampled-data model (see Fig. 1) ; 


(Al) 


where 


x ... . = A.x, . + B.u A 
(k+l)A A kA A kA 

i 


A AA 
= e 



= A _1 (e^- I) if A -1 exists 


A - sampling period 
= sampling rate 



(A2) 


(A3) 


(A4) 


1 



Figure X 


Definition 

A^ is discrete-time-sense (DT) stable if 

|X^(A^)| <1 V eigenvalues X^ of A^ 



(A5) 


The following (Lyapunov) results will be of use in deriving the results 
for the rest of the report: 


Discrete-time Stability Theorem (Lyapunov) : 
Suppose 3 K > 0 and Q > 0 such that 

K * A T KA + Q 

Then A is (DT) -stable . 



For the rest of Section A of this report, the notation A^ and shall 
be used to denote general discrete-time system parameters i.e., they need 
not satisfy (A3); the results of Theorems 1 and 2 are valid for any linear 
discrete-time system, not just those which are sarapled-data system models. 
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m (DT) - Summary of known results 


00 


s .t. to ^ + « a b ^ 


(A a# B1 stnbilizable 
(£$> A^) detectable (A7) 


* T 
\ ‘ G i \ 


m m -1 m 

V^'I'V Wi 

k a ■ a I*a - k aV r + b Iw' 1 b X } \ + 6 
~ k a ■ (a a - b A>\ <a a + vl> + 8 + vA 

<-*> K. ** A a K.A a + q - g a ( R + B a K a D a )G a 

A AAA A A A A A 

A mA AT Ta T 

K 4 - Wa + «4 - M A°A (R + B A K A B)G A M A 

where 

Sa = M X*< A 

w h “ <*A + “JV* V A A + BG aV + 8 A + H A G A RG X 


In what follows we shall assume that Q > 0 


Theorem 1 (Discrete-time LQ-gain margin property) 

T 

(A^ + B^/VG^) is stable (DT) if: 

(G^Q - 1 G ^) _1 + A T RA > (A T - I) (R + E £k a B a ) (A 


3 


or equivalently, 

( + *<»5va>' 1 * + *) > 

(a t - 1 - Krt^V' 1 ) (b IVa> ( A - 1 - ‘•aVa’’ 1 *) <“ 9 > 

n 

Remark 

From equation (A19) , in Theorem 1 it is obvious that there is both an 
upper bound as well as a lower bound on the values of the admissible A, 

This is most transparently demonstrated in the case when there is only a 
single control-input, so that A becomes a scalar in this caset 


Corollary 1.1 

(for the case of a single-control input LQ-design) 


[a a + b^ « gT "| is (DT) -stable if 

(1 + - VH; +r < 1 + »') < “ < (1 + s> * VMw tc<1 + ^) ( “°> 


where 


A T 

" “ b A K A b A 


A 
w = 



1 

g A 



Theorem 1 can be re-stated in a different way which shows explicitly 
the range of admissible A , by simply generalizing the above ' Square -rooting ' 
procedure used for the single-input case to the multi-input situation: 


Corollary 1.2 

(A^ + b a Ag I ) is <DT) -stable V 
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A * (I + W^R) + (M 1 )V i (W A )"^ 

for all S « S T s.t. 0 < S < I 


where 


M 1 ‘ [ (G I 5 " 1g 4 ) " 1 + R "I"* + R 


"A- (b IVa> 


Theorem 2 (General Discrete-time LQ Gain Robustness) 

(A a + B^FgJ + <Sg T )) is DT-Stable V SG B RtQ^G^) 1 and pen 
such that 

($g'V' ;L <Sg < [^ W A + (W A (I-P) + R)z" 1 ((I-F T )W a + R)j -1 


mxro 


(A21) 


where 


and 


Z » (G A Q” l G A ) " 3 ' + F T RP - (I-P T ) (W A + R) (X-F) > o 


W A ' b 1 K A B A 


(A22) 


R emark 

Theorem 2 is the discrete-time version of Corollary 2.1 in Wong, Stein 
and A than s for the continuous case. Unlike the continuous-time result, the 
discrete-time version is much more complicated and is probably of little 
computational usefulness. 

B. Sampling-time Robustness of LQ-design 

Given the system x = Ax + Bu (Bl) 
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Suppose wo sample the system state at rat® (V A ) . The equivalent 
sampled-data model of tho system is: 


x (k+1) A * A A»kA + VkA 


<B2) 


*a " 


M 


m M^B "(/ © AT dT) B 


If we choose a discrete- time LQ-design to stabilize the sampled data 
model (B2) , then the closed-loop system + B^gJ) is stable, where G? is 
the optimal gain computed for the sampled-data model when the sampling rate 
is \ and for the cost-weightings Q and R. 

Suppose now we chango the sampling rate to (~~*) ; the corresponding 
sampled-data model bocomas 


x (k+l) (A+A') * a A+A ' \ (A+A ' ) + B A+A * U k (A+A ' ) 


(B3) 


„T 


If we do not change the gains computed previously, the new closed- 
loop system at the new sampling rate becomes 


<A A+A , + B AxA< * 


A+A 1 


(B4) 


which of course is not necessarily stable. The problem we want to pose iss 
for what range of A' would (B4) remain stable? 

We have the following sufficiency result: 


Theorem 3 (Sampling-rate robustness of LQ-design) 


(A, 


,T 4 


A+A' + B A+A» V is stablQ if 


L 


* 


\ - o A A '(K a -Q) o M ' + (e M * + M a ,m~V 
> W^M'V G & (R + (H^,^ 1 ) 


CB5) 


Remark 


„ “3. _ M' v M. -1 . .-1 , 4 

M A' M A * (I •* o ) (I - « ) if A exists 


Remark 

It is not obvious what physical interpretation can be made of the 
expression (B5) ; some numerical examples will be worked out to gain insight 
into the moaning of (B5) in future research. 

Remark 

The case when A' * A (i.e. doubling of sampling period) is a particu- 
larly simple special case of Theorem 3; 


Corollary (Robustness to doubling of sampling period) 


,T 


(A oA + B oA G A ) is (DT) -stable if 

La 


aV aA 


Q + o” “Q o *** + (e A I)G^RG^'(e AA + I) > 2 G a (R + B A K A B A )G A 


(B6) 

fH 


AP PENDIX 

Proof of Theorem 1 

The proof of Theorem 1 follows immediately from Theorem 2, as (A21) is 
automatically satisfied for <$G =0, and wo need only to ensure that (A22) 
holds, but (A18) is just (A22) Ly substituting A * To show that (A18) 

is equivalent to (A19) , we just have to "complete square" by appropriately 
factoring A. Hi 
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(algebraic details; let G^QG^ * W Q , b a k A B A « M 


Then (A1Q) <~> w" 1 + A T RA - [A T (R+M)A - (R+M)A - A T (R+M) + (R+M) ] > 0 


<~> W’ 1 + A T (R+M) + (R+M) A - (R+M) - A T MA > 0 
<“> w; 1 - (R+M) - (A T MA - A T (R+M) + (R+M) A) > 0 


w" 1 - (R+M) + ( R+M) M -1 (R+M) - (A T M - (R+MJJm” 1 ImA - (R+M)J > 0 
o * 


<"*> w; 1 - (R+M) + RM _1 R + 2R + M - [A T - (I + RM _1 )]M[A - (I+M^R) ] > 0 

<“> w" 1 + R + rm" 1 r > IA t - (i + rm _:L )]m[A - (i+m -1 r)3 


Proof of Corollary 1.3 


The proof utilizes the following lemma: 


Lemma 0 


{H T |h T M 2 H < M. Where > 0, M 2 > 0} 


= {H T jH T = + M^(M ^)" 1 , V 0 < A < 1 } 


Proof 


h’.j^ wj) _l 


H T M 2 H = M^AmJ < » M 1 


Proof of Corollary 2,1: 


T -1 

Let H = A- (I + W. R) in the above lemma and substituting appropriately 


for M x , M 2 . 
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Proof of Theorem 2 


(Assume without loss of generality that [G^iSg] is of full rank in what 
follows) 

We have 


so 


where 


K & ■ - a - <V* * tfw°I 

K A » (a a + b a (fg a + 6g t )) t k a (a a + b a (fg a + 6g t ) ) + 5 


3 4 2 - V R - V s ! 




[(g a f t + 6g)b^k a a a + A^K a B a (FG^ + «G*) 


AAA AAA A 


- (G f t + 6G)b\ b (PG* + 6G T ) 

A A A A A 

* Q - G A [R + W A + F T W a F)G^ 

A A A A 

- (G a [F T b\ a A a + F T w A 6G T ) + [a\b F + 5GW A F)G J 

A AAA A AAA A A' 

- (6G[B a K a A a ) + (A^K.B a ]$G T ) 

AAA AAA 

- <SG W a 6G T 

«q-gjr + w,+ f t w ,F] g! 

A A A A 

+ G A (F T (R + W )G*- F T W a 6G T ] + [G a (R+W a )F - <SG W a F]G a 

+ <$G(R + w a )g^ + G a (R + W a )6G T " 6G a W.6G T 
AAA A A A 

- Q + G rp T (R + W A ) + (R + W a )F - (R + W.) - F T W.F3 G ! a 
A A A AAA 

+ G A [R + W A - f’VjSg’ 1 + 6GtR + W A - W.FlG^ 

A A A AAA 


- <$g a w a <sg 
A A 

Q + [G 6G] 

A 


T 


F T RF - (F T -I) (R + W a )(F-I) • R - (F T “I)W 

A 


R - W (F"I) 
A 


-w 


A 


( 2 . 1 ) 

( 2 . 2 ) 



" T " 


g a 


_6 g T . 

i 


(2.3) 


4 M 


Since Q > £# we have 


Q > 0 <-> q" 1 + Sg] M 


_T 


«G 


,T 


sf 1 > o 



o" 1 + Q ~ l [g a 6g] m 


_T 


6g 


T 


.-1 


)‘ G 


■a S V * 0 


(see Lemma 1 in Appendix of Wong# Stein, Athans) 


px, 0 1 


rx, o i 


rx, o n 

1 

+ 

l 

M 

l 

o x n 


o X. 


o X. 

L 2 m 


2_ 


2_ 


> 0 


, .. A T -1 

where X, = G.Q G. 

1 A A 


X 2 = 6G T q” 1 AG and <5G 6 R(Q _1 G^) 


<==> 


X 1 + X A X 1 X 1 M 12 X 2 


X 2 M 21 X 1 


X_M X_ + X„ 
2 2 2 2 


> 0 


<=> 


x i + Wi > s. 


-1 


X 2 + X 2 {M 2 - WWl + V X l“l2> X 2 > 2 


(2.8)<=> X' 1 + M x > 0 


<=> Z = (gJq“ 1 G a ) + F T RP - (,F T - I) (P, + W A > (F-I) > 0 


(2.4) 


(2.5) 


( 2 . 6 ) 


(2.7) 


( 2 . 8 ) 

(2.9) 


( 2 . 10 ) 
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f 


(2*9) and (2.10) 

C > X 2 + X 2 [M 2 - M 21 Z ' lf, 12 )X 2 » a 

<-•> x“ X + {m 2 - M 21 z" 1 M l2 } > 0 

x” 1 + {-W A - (R + W^d-Fjjz" 1 (R + (I-F T )W a )} > 0 
< > x” 1 > tw A + (r -f w a (i-f))z" 1 (r + (x-f t )w a )] > 0 

x 2 < [W A + (R + W a (X-F) )z~ l (R + (I-F T )W a )] (2.: 

Thus we have shown that 

(2.10) and (2.11) «•> Q > 0. *^> (& A + B A (F G A + 6 g T ) ) is stable (DT) 


from (2.2) 

5 

Proof of Theorem 3 

The proof of Theorem 3 is facilitated by the following lemmas: 


Q.E.D. 


Lemma ! 

A. commutes with M. . 
A A' 

and M. , 
A' 

Proof 

A' A' 



M 0 Rx dt .( 

Ax,_ ‘ 
e dt e 


M ; 
g \ 


\ J e AT dx) = (e" M ) (J e AX dx) = (J e AT dt e" M J 
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Lemma 2 


Proof 


Lemma 


Proof 


(A^ + B A G A ) is stable <“> (A^ + B G^M^) is stable. 


(A^ + B^G ) stable 

<-> M^ 1 (A^ + B a G T )M a stable 

■ "a\ H A * B °\ 

- m aVa ♦ B B \ < •' Va ■ W 


= A a + B G M a 


%A' ' m A + a A M A' - "A- + V M A 


*». -f" ^ 


M 4 . AA /- A+A * A (X-A) 

= M * + e / e dT 

A •/ A 


AA 

=M A +e M a , 
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r 


Proof of Theorem 3 

wo have (A^, + B^.G*) stable (DT) 

T 

< > (A a+a , + B M a+a , ) stable (DT) from Lemma 2 

’ l h * B G I Wtf’V 

■ (A* + B G? (M a , + MA,)aIVa, from Lemma 3 

A A A' A A' A' A' 

T? -1 

» (A + B G (M + M a ) i A 

' A a V A A' A' J A' 


V fe* e - V R + B lhVi 


a A T 1 rn^ m 

** V a aW s a - Va < r + b a k a b) GA 


where K. * M.K A M. 

A AAA 


S A " M IVa 


\ from (A12) 


to (A15) 


where 


r T 

V L a a + E g >a + H A' A A'>] \[\ + B g >a + m a'V’] + »i 


«A = V p Va g I p - (pl ' - V W> - m a> 


(after some algebraic manipulation) 

Ta 

with W. 5 B K a B 

A A 

(3.3) ■=* (A & + B G® E ) T J + B a G*P)A a , + A* ,8^4 

- «W + B g a m a + a. )T H (! W + B g a m a + a«> 




(3.5) 


•„* \ « 


F 


( 3 . 6 ) 
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ATTACHMENT 1 (of ESL-SR-835) 
GAIN-MARGINS AND STABILITY ROBUSTNESS OP LQG REGULATOR 


by 


Poh Kam Wong 
Gunter Stein 
Michael Athans 


ABSTRACT 


New sufficiency characterizations of the gain-margins of the 
standard full LQG (Linear-Quadratic-Gaussian) regulator design (which 
incorporates a Kalman filter in the feedback loop) are presented. 
These results show that full recovery of LQSF-gain margins can be 
achieved either through non-divergent filter structure adaptation, 
or when plant-driving noise that enters through the same channels as 
the control inputs greatly dominate other noise terms. An explicit 
sufficiency bound on the gain-margins of LQG-design that varies with 
a ratio of quadratic forms of the filter error dynamics & the plant 
dynamics is also presented. These results further clarify the recent 
work of Doyle, and suggest potential new directions of research. 


1 . Introduction 


As has been demonstrated in recent research (e.g. (1),[2) and 13) 
and references cited therein) , the standard multivariable Linear- 
Quadratic-Stata-Feedback regulator design (LQSF) is known to have rather 
robust stability properties. In particular, as has been shown in (3), 

the LQSF control design has the following gain-margin property. 

* , , 

If u (t) is the optimal LQSF control gain-vector, then the cloaed- 
, * 

loop system plant under the control of u (t) remains stable for all 
gain perturbations; 


where 


u (t) I- — ■*“ A(t)u (t) 


A(t) 


a x (t) 


' a (t) 
n 


is such that 


A(t) > | (I-x“ X ) 

— 2 — —o 

A 1/2 T -1 1/2 

where « (R x G^Q G^R ' ) , 2. > £' J* diagonal matrix > 0 being 

T 

the LO cost weightings, and G is the 

*“*0 

optimal gain matrix. 

That is, LQSF guarantees strictly greater than - 6db. gain reduction 


& infinite gain margin, regardless of the choice of cost criteria 
£ > 0 and R diagonal > £. 


Because of this and other stability robustness properties of the 
LQSF (see [2] , [3] for further details) , there has been great interest 
in the question as to whether the full Linaar-Quadratic-Gaussian regu- 
lator design, which employs output feedback using a Kalman filter, 
retains any of these stability robustness properties in general and 
the gain margin property (GM) stated above in particular. In a short 
paper entitled "Guaranteed margins for LQG regulators," and carrying 
an abstract with the single sentence "There aren't any," J.C. Doyle 
has shown through a simple counter-example that there exists no guar- 
anteed gain margins independent of the choice of cost-criteria & noise 
characteristics specification . In other words, design-parameter-de- 
pendent characterizations of the gain-margins of full LQG-system need 
to be investigated before one can evaluate the stability robustness of 
the LQG-methodology . 

It is the aim of this report to present preliminary results of 
our research in investigating the design-parameter-dependent charac- 
terization of the gain margins of LQG regulator. 

The organization of this paper is as follows. In Section 2, we 
state our formulation of the full LQG gain margin characterization 
problem. In Section 3, some useful sufficiency results which we have 
obtained are reported and their significance discussed. Finally, in , 
Section 4, we present discussion on potential future research directions. 
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Notations and Definitions 


f 

! 

i 


T 

A denotes the transpose of A 

R(H) denotes the range space of H 

R(H)*^ denotes the orthogonal complement of R(H) 

If 2. e R™" is positive definite (positive semidef inite) , we 

will writes 2 > £ 9) 

T 

If 2 i £ a nd x 2 2, > 0 ^ or ail x e R(H) , x f 0, we write 

£>£| 

1 R(H.) 

(i.e. the positive semidafinite matrix 2 is positive in the range 
space Of H) . 


2. Problem Formulation 

T 

Given the linear time-invariant dynamic system (A, B, C ) such that 

(A,B) is a stabilizable pair (1) 

T 

(C ,B) is a detectable pair (2) 

T 

Let G^ denote the optimal LQSF-control gain for some 2 > £ and 
diagonal R > where 


KA + a t k - kbr'Vk + 2 “ £ 


T A -IT 
G = - R B K 
— o — 




Further, let H denote the optimal Kalman filter gain for some 
*~o 

£ > 0 and 0 > 0 , where 


and 


X J\ T + *£ - £ C fV l + J » 0 

M>* mm mm* mm* 

# k . I c o ' 1 

~X> u — 

Then the closed-loop, full 1QG- system becomes: 


(5) 

( 6 ) 


where 


BG 


,T 


T T T 

-H C A + HC‘ + BG 


+ (noise terms) (7) 


x(') « plant state vector 

A 

x{*) » filter state vector 

(we shall ignore the external noise terms in what follows as they are 

not relevant in subsequent discussion on closed- loop stability) . 

* w 

Suppose now that the optimal feedback u (t) « G x(t) is perturbed: 


u (t) I * A(t)u (t) 


where A(t) is a diagonal matrix for all t E (0,«>) . 
The perturbed closed-loop system becomes 


( 8 ) 


x(t) 


A B A(t) s' r 

— — — *-o 

„ 

ss 

- *<*) - 


T T T 

~H C A + B G + H C 

^ —* — o — q ^ 


(9) 
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Proble m For what range of A(t) , t e[0,«) can we guarantee that the 
purturbed system (9) is stable in the sense that 



Remark : 

The class of perturbation (8) includes the class of all non-dynamic, 
nonlinear functions: 


uj(t) « 1 (uJ(t) f t) 

provided 

f^(0,t) " 0 


i*l , • • • ,m 


( 10 ) 


This follows from the simple observation that, given (10) , we can define 


and 


X^(t) ■ 


f^u^t^t) 

u*(t) 


A 

tat 


arbitrary , 


» 



0 

A (t) 
m 


uj(t)^ 0 

u*(t) = 0 


i — 1, . . . ,m (11) 


Note that the restriction of diagonality onj^(t) was made in (8) 
because of the natural interpretation of hit) that follows from (10) 
and (11). 


» 
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Remark? 


We shall first examine the case 


A(t) S A constant matrix (12) 

in what follows. The general time-varying case of /V( t) will be covered 
by a trivial generalisation of the time- constant case in a later section. 
This procedure of presentation not only simplifies the proofs, but also 
helps to make the methodology of analysis (simple application of Lyapunov 
theory) more transparent. With the assumption (12) given, the stability 
of (9) can be investigated by examining the stability of the system matrix 


BAG 


,T 


~H C 
-o 


,T 


O 

T T 

A + B G* + H C 

— *'*•* — O " "' O 


(13) 


(in the sense that (13) is stable if all its eigenvalues have negative 
real parts) . 


Remark 

In the above formulation we have assumed that the Kalman filter 
structure remains fixed at the nominal design values in the face of the 
control feedback perturbations. For greater generality, we can assume 
that some knowledge of the control perturbations may be 'communicated' 
to the Kalman filter design, or that the Kalman filter structure can be 
adjusted to 'track' the control perturbations in some manner to be 
specified. This can be incorporated into our problem formulation by 


assuming that the filter structure is of the following form: 


x(t) » (A + B A G T )x(t) + H C T (x{t) - X (t) ) 

— ~0 — ""O — — ' 


» (A + B A G T + H C T )x(t) - H C T x(t) 


(14) 


where A s ('adjustable') filter structure parameter 
» I nominally 

By incorporating the assumptions in Remark 2 and ,3, we therefore arrive 
at the following modified problem formulation: 

,LQG Stability Robustness Problem 
For what A 



p 


r i 


X, o 


X, 0 


1 - 
• 

A 

and A = 

1 

t 




’ ♦ A 


o X 


0 A 


m _ 


L— m 


is the closed-loop system matrix 


-H C 


T 


B A g t 
o 


A + B A G + H C 

— — * — — o — o — 


<*) 


stabile? 


Results 

The main results we have obtained in the direction of sufficiency 
solutions to the LQG Stability Robustness Problem as formulated in the 
previous section will be presented in this section in the form of four 


propositions. A fifth proposition generalizes the previous results to the 
more general time-varying gain-perturbation case, in arriving at these 
results we have utilized nothing more than simple applications of standard 
Lyapunov theory. The basic results from which all the Propositions in 
this section are derived has been stated as a Lemma ( Lemma 4 ) in the 
Appendix . 

Our first result pertains to the special case when we have perfect 
'tracking' of the gain perturbation, i.e. when we have 'communicated' 
to the filter structure the exact perturbation values A, so that 
A = A. 


Proposition 1 ; 

A 

If A = A then (*) is stable for all 


where 


A > I <£ “ ST 1 ) 

— Z " “O 


„ A , 1/2 T -1 1/2 

X = (R ' G Q G R ' ) 
~o " -o 


(15) 


i.e. 'l’he LQSP- gain margin is completely recovered. 


Remark : 

The condition _A A in Proposition 1 ensures that the filter error 
dynamics are ' non-divorgent' . This is best seen by examinig the error 
equation in detail: 
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( 16 ) 


e - x - x 

e ■ (A + ttJZ T + B(A - A)G^)e + D(A -A )G^x 

A 

if A 5 A then the 'feedback' driving tern from the plant-state drops 
out, and the extra tom in the system matrix of the error dynamics 
di sappears. 

Remark ; 

Since LQSF- gain margin may be wide enough to tolerate some channel 
failures (see f3] ) , Proposition 1 guarantees that such reliability of LQSF 
design remains with LQG provided corresponding change in the filter 
structure is made. 


Proposition 1 assures us that full recovery of LQSF gain-margins 
is guaranteed with perfect knowledge of gain perturbations incorporated 
within the filter structure ( 'non-divergent' estimation, see [1] , [5] 
for more details) . There is another special situation under which 
similarly full recovery of LQSF gain margin can be guaranteed; this is 
the substance of our next proposition: 


Proposition 2 


If 


min 

T i 

A Szl 


m rp 

x (-(A+H^ )xJ 

m T 

x (- (A+BG q ) x] 


(17) 


max 

T i 
X X=1 


>+ co 


Then (*) is stable for all 

A > “ (I - x! 1 ) 

i.e. the LQSF-gain margin is recovered in the limit as the ratio 
(17) tends to infinity. 

While Proposition 2 demonstrates that full LQSF-gain margins are 
recovered in a specific limit, it does not tell us anything about the 
'rate of convergence' to gain-margin recovery, i.e. the explicit 
dependence of gain margins on the ratio (17) . The following Propo- 
sition provides a partial answer to this question by giving an explicit 
sufficient bounds on the gain margins. 


Proposition 3 

A 

Suppose A = 1. Then (*) is stable for all A > 0 s.t. 


where 


with. 


Ax < A < A I 


A, = l + 1//5T 


X a max{l~ (1/x ) , 1/A,} 

—• O *i* 


to - max A (W ) 
o — o 

W = R" 1 / 2 B T K Q" 1 K BR -1 / 2 
— o — f— — f — 

K f (A + H^ 1 ’) + (A + H 0 C T ) T K f + Q + G _RG^ 

A . , ■ 
x = max A (X ) 

X k R 1 / 2 £ a _1 G R 1/2 
-o — — o & — O— 


= 0 


(18) 

(19) 

( 20 ) 

(21a) 

(21b) 

(21c) 

(21d) 

(21e) 
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Moreover, satisfies the following bound: 


✓=« 


WW 8 ! 1 Sa . 


- X min-’ X . <8+GKG*> 
mxn — — o — o 


[ X T (>(A + HC T )X] 

X X»1 " 


lx (r -1 b t b) 

I max — 

V X . (Q) 

' mxn — 


( 22 ) 


Remark 

The bounds on A obtained in Proposition 3 are only sufficient , and 
are in general rather conservative. Moreover, they are not the tightest 
possible bounds that can be derived from our approach (they have been 
essentially derived from Lemma 4 by choosing the parameter a to simplify 
the solution of the bounds rather than to optimize them, which entail 
much more tedious algebraic manipulations) . The actual numerical compu-* 
tation of the parameter is straightforward although a bit tedious 
(requiring the solution of a Lyapunov equation (21)), but perhaps of 
greater theoretical significance is the simple bound on given in 
Equation (22) . Taken together, Equation (18) and Equation (22) show 
that the upper bound on the gain-margin increment increases at least 
linearly with the ratio 


mxn , T , _T. , 

m (x (-(A+H C )x) 

X X=1 

T (/<-(*+«£>*) 

xx=l 


Remark 


In the results presented so far, no use has actually been made of 
the fact that the filter incorporated in the feedback loop is a Kalman 

filter, the only information of the filter we have utilized is the filter 

T 

error dynamics matrix (A H q C ) which could well have been designed 
by any other methods. More generally, therefore, the above results 
actually apply to any full-state filter design incorporated in the control 
feedback loop, and we can conjecture that similar versions of Proposition 
2 and 3 apply in the case of any estimator dynamic compensator incorporated 
in the feedback loop. 

Remark ; Note that g > 0^ is crucial for Proposition 3 to hold. 

The next proposition, unlike the previous ones, explicitly make use 
of the assumption that the filter design incorporated in the control 
feedback loop is a Kalman filter. The basic question of interest is, for 
what choice of the noise specification 0 will it be possible for the 
LQSF-gain margins to be fully recovered? Proposition 4 provides one 


answer . 


Proposition 4 

A T 

Let Hi and suppose that $ « $ + H B for some H > 0 and 

scalar <f» 2 > 0, and where 4> > 0 f 

Then as <j» 2 •* 00 

The gain margins of A approaches 

A > i (I - If 1 ) ■ 

i.e. full LQSF-gain margins are recovered as the plant driving 

noise- terms entering directly through the control input channels becomes 

* 

greatly dominant (i.e, if B u is the control term, the noise term j» 2 
that gives rise to the variance 4>_ B S_ B enters as B{ii + w )) . 

Remark 

Proposition 4 is essentially the same as Doyle's result in Doyle 
(6) (where his assumptions are slightly different, and unnecessary, 
from ours) but our proof technique is completely different from his 
(which is a 'frequency domain' computation) and moreover our initial 
motivation has been independent from his work. 

The most natural interpretation of Proposition 4 is that, for those 
systems whose plant driving noise-terms enter primarily through the same 
channel as the control inputs (hence the form of the noise- variance term 
^2— — ® ^ themselves , recovery of LQSF-gain margins tends to be facili- 
tated, with recoverry complete if these plant driving-noise terms 


becomes greatly dominant: over the observation channel noise , This makes 
sense intuitively, as Doyle pointed out, because the noise that enters 
the plant through the some channels as the control inputs can be inter- 
preted as perturbations on the control inputs themselves, and this will 
get communicated through the mathematics into the filter design in such 
a way as to provide 'hedges* for the uncertainties in the control inputs. 

Remark 

A 

Although we have assumed A s I in in Proposition 4 (as this is the 
case of interest) , this assumptions is actually not necessary - any 

A 

finite A will do, as is obvious from the proof. Of course, this can 
only be true in the case as (j)^ *+• ", For large but finite there can 

A 

be great differences on the gain=-margins depending on what value A takes. 
Example 1 

To illustrate the above propositions, consider the following single 
state, single control and single output system; 

A = a > 0, B = b C T = c 

£ - q , R «* 1 

£ ■ 4 >, 0 = 1 

The regulator design .is: 

1 + + (l/n)J (Riccati matrix) 

g 0 = -f-[i Wi + (vn) 



(Optimal gains) 


where 


where 


and b) 

o 


X o “ + V 1 + ^ J 

(R l,/2 GV l G R V2 ) 
- '~o~ *-o — 

a + bg^ * - (^1 + 1/n )a 

(closed loop dynamics) , 

A 2 2 

1 » a /qb , Also, by duality, 

the filter design is 

0 « 5~ [i + J\ + i/n f ) 

c 

(covariance matrix) 

h » « $ [1 +\1 + 1/ru J 

(filter gains) 

a + h Q C « - (\1 +■ l/n f )a 

(error dynamics) 

A o 2 

. » a /<j>c' * Then the K_ matrix of equation (21) is given 

C- £ 


K f « * — a.-- 1 1 + Mn +yfr+ n 2 j , 

2a\ 1 + ^ 

2 

a 

of (19) is 
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1 


If wo lot q, <|> t o be ouch that 

- »(§)’ 

* ,> (I ) 2 

Then 


(i*o. a wide band regulator) 
(i.o. a wide bond regulator) 


n 


n< 


(t) : 

(t) ; 


*>• o 


+ 0 


and x •* 1 
o 



and we have 


or 



, 7m. 

\<* 2 


The following representative values of X and A_ as a function of 


& 

fr) 


are illustrative: 

« «1 1/100 1/16 1/4 1 4 16 100 »1 

„1 11/10 5/4 3/2 2 3 5 11 

- 1 10/11 4/5 2/3 1/2 1/3 1/5 1/11 0 
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The results presented so Ear have been restricted to the case 
of control perturbations of the form! 

u*(t) h*~ A u* (t) for all t e[0,») (24) 

where A is a constant matrix. We now consider the more general case 
when the perturbations are given as time- varying : 

u* (t) *-*- A(t)u*(t) t eiO*») (25) 

As it turns out, the extension of our results in the previous 
section to the more general case (25) is trivially simple: 

Proposition 5 

If for each t E[0,«>) point-wise, the functions A(t) and A(t) 
satisfies the conditions on A and A in any of the previous Propositions, then 

that proposition holds for the time-varying perturbations {A(t), t etO,~)}, 
and M(t) , t e[u,«)}. 


Remark 

Recall that, in general, if {A(t), t is such that for each 

t pointwino , A(t) has nil its eigenvalues with negative real 

parts, it still need NOT be true that 
» 

x(t) * A(t)x(t) 

is stable (in the sense that x(t) 0 as t ■* ») . Thus one cannot 
•prove' Proposition 5 by arguing that, if 

** A 
A (t) - 

(all eigenvalues have negative real parts) for each t etO,*®) pointwise, then 
x(t) » A(t)x(t) , t e[0, w ) 

is stable (x(t) •> 0 as t *► «) , The fact that Proposition 5 neverthele ss 
does hold is because of the guaranteed existence of a single Lyapunov 
matrix for all t StO,® 0 ). 

Re mark 

The perturbation class {A(t) , t £[0, ■«) } can bo trivially extended 

ft 

to the more general one of {A( (x(*t) , u (T) , T£[0,t)},t), t e(0, ro )} which 
incorporates dependence on x ( • ) and u* ( * ) . 


A 


B A(t)Q T 
*** *’*'0 


■HC 

—o— 


T 


A + B 




H 
— o 


is a stable matrix 
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Future Re eear oh Direction* 


Several area* of potentially fruitful research are readily sug- 
gested by the preliminary results vs have obtained so far. We shall 
briefly list some of these below, not necessarily in any order of 
suggested priority. 

1, Determining the 'rate of convergence' to LQSF-gain margin 
recovery by the noise specification 

T 

«* ♦ + iJ» 2 B S B as <}> 2 varies 

Although proposition 4 {and Doyle] has suggested the 
desirability of using noise specification of the above 
form for gain-margin consideration, that result, like 
Proposition 2, is a limit characterization that provides 
no clues as to the behavior of the gain-margins as <j> 2 
varies. An explicit sufficiency bounding solution si- 
milar in form to that of Proposition 3 which can 
demonstrate the dependence of some sufficient gain- 
margins bounding on <J> 2 will be highly useful in prac- 
tical design. Since the proof of Proposition 4 uses 
a procedure closely similar to that of Proposition 2 
and 3, it appears that such a sufficiency bounding can 
be similarly derived for Proposition 4. We have not 
had sufficient time to investigate this. 

2. As noted, the sufficiency bounds in Proposition 3 are 
not the tightest possible that can be derived from 
Lemma 4. A more careful effort in optimizing the 
bounds by exhausting all the free variables provided 
by Lemma 4 may lead to significantly tighter bounds. 


proposition 2 and 3 have pointed out that, purely from 
the gain-margin maximization point of view, those filters 
that have largo ratios 

min )^J 

maxt-a 1 (a+B0 o T )a) 

tend to be better. The following question therefore 
arises* Is there a simple way to classify the set off 
all possible design parameters 


into those combinations that have the property (P) 
and those that tend to be otherwise? 

We have introduced the parameter % into our formulation 
as it provides a natural interpretation of how a filter 
might adapts its structure to minimize ’divergence'. 

The actual implemcntatlonal consideration of this 'gain- 
perturbation tracking' concept may lead to practical 
design significance (o.g. how to modify filter struc- 
ture when there in control channel failure to 
guarantee stability of LQG system. The parameter 
K tells us what needs to be changed) . 

Extension to discrete-time system, similar to what 
has been done for the bQSF case [5) . 


Application of results (especially Proposition 3 and 4) 
to some real physical systems (e.g. aircraft) to study 
the actual behavior of gain-margin bounds as $ or 

m * 

(A+H C ) are varied. 

0 *“* 


APPENDIX 


The following lemmas will be useful in the proofs of the propositions 
in this paper. 


Lemma 1 


_ - ... „ _nxn ,, „ _mxm . . , „nxm . ... 

If E R , M 2 E R are symmetric and HER is arbitrary, 


then 


-1 > - 


T. 


(M x + M x ) > 0 


R(H) 


=> M, + M,HtLH T M, > 0 
*”**X *-'± 


Proof 


See [2] , Lemma 1 proof. 


■ 

■ 


Lemma 2 


If 2, > 0 and q 2 > a^\ 2 


Then 


% -12 


L 2-21 - 2 


> 0 


Proof 


See any standard Linear Algebra text. 


Lemma 3 


JHf 1 ’ + HM^’) ~ 1 H » [M 2 + (n T M“ 1 H )“ 1 ]~ 1 


where > 0, ancl the inverses defined in the equation exist. 
Proof 


H T (M x + HM 2 H X )" i H « H X {M~ X - M~" L H(m“‘ L + 


.1\ -1 


. t.T. - 1,,. _ 1„T. ~li 


« - (H a jM^H) (m " 1 + 


» [M 2 + (hX'VV 1 


Lemma 4 


(*) is stable for R > 0_ A and A diagonal if there exists a matrix L > J3 
and a matrix 6 > 0 for which the following conditions hold: 


(i) 2A - (I + L) + X X >0 <=> A > ~ ( (I+L) - X -1 ) 

— — O "" m 2 ~~ * O 


(ii) £ > G R 1/2 [I + jfW^G 1 
-~o~ ~ — O — — o 


(iii) Q > G^LR + (A-L)R 1//2 [2A - (I+L) + x" 1 ]" 1 R^ 2 ( A-L ) }g^ 


a a # 2 —1 r T A 

4- KB (A- A) {L R) X B K 


where 


S' M , IV T A A 

K(A + H C ) + ( A + H C ) K + 2 = 0 


Proof of Lemma 4 


We have 


A 


BAG 


-H C 
—o— 


, r r 


T T 

A + H^C - BAG q 


(Al) 


Let e = x-x 
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J 


Then (AX) <*=> 


T 


A + BAG 


B (A- A) G 1 ’ 
— — — **~o 


bAg 

•m n 

A + H C T + B (A-A) G T 
' — — - - *—o 



(A3) 


The matrix A can be rewritten as 



T 

A HH BG 
— -o 

z 


BIA-DG 1 ’ 
— o 

b(A-i)g t 

*"* *“* *~~o 

A ** 

0 

T 

A 4* II C 

4 

B (K- A) g t 

— Q 

b(A-A)g t 


A 

~o 


$A 


(A4) 


Since is a stable matrix , for every Q > 0^ there exists a K > JD 
such that 

*N# 

KAq + A^K + Q - 0 


(A5) 


by Lyapunov Theorem. 


If we choose 


~ A 
2 “ 


Q 4 G RG 


T 


T 

G EG 


5c3 G 

A 

Q 


T 


> 0 


(A6) 


(where £ > JO is to bo specified s.t. (A6) holds) 

K 0 


Then (AS) “> K = 


/\ 

0 K 


(A7) 
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where k > £ is the unique solution to the Riccati equation: 

KA + A T K - KBr"Vk + £ * 0 

A 

and K > £ is the unique solution to the Lyapunov equation: 

K(A + U^) + (& + H. c fi. T ) T K + & » £ 

Further, from (A5) , we have 

K (A + 6a) + (A + (5A) T k + 60 = 0 

“tD —o ***■' — • 

where 

+* A ■** ** 

s 2. “ (k6a + 6a k) 

•v 

so from Lyapunov theorem, we know that (A + 6 a) is stable if 

~~o — 

> £ 

*v »w 

Given the choice of 1 Q as in (A6) and the corresponding form of K as 
in (A7) , we get (with R diagonal) 

nt fT A m a 

Q + G (2A-X) RG G RAG + G (A-A)BK 

m ““O "“O Q O “O 

60 * 

G ^RAG* + KB(A~A)CT 2. + ^WlBK + KB (A-A) c£ 

From Lemma 2, the condition (A6) is equivalent to: 

Q + G o RG o > £ (which is true from definition of Q) 

A m m _ 1 m 

Q > G Q RG* (P + GqRGq) £q55o 

4 


(AO) 


(A9) 


(A10) 


(All) 


(A12) 


(A13) 


(A14) 
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(from Lemma 3) 


Since (A14) <«> 

where 


S > g o h 1/2 (x + jfV 1 r 1/2 g^ 


(A16) 


what remains to bo proved is that the conditions in Lemma 4 are sufficient 
^ or ^ £’ Now, from (A13) , we have for any diagonal L 


<SQ 


Q + G ( 2 A— (i-|-L) RG 

~~ — O — “ 


X 


[syEL(A-li)G 


T 


A 

£ 


G R(A-L )G 

“O ~T> 

GJtLG^ - KB (A-A) 2 (LR> "V* 


G 

* Tfc O 


LR[G*, <j£ + l" 1 r" ;I (A-A)B T K) 




G + KB (A-fojTV 1 


(A17) 


L J 

If L > 0, then the second term of (A17) is positive semidefinite, so if 
the first term of (A17) is > 0, then it will follow that 6 q > 0. But 
sufficient conditions for the first term of (A17) to be > 0 are as follows 
(from Lemma 2) : 


{ Q + G Q (2A--(jE+L)) RGp > 0 
Q > G q (h- L) RG^ [g. + G q (2A-(I+L) RG^]" 1 G^R(A-L )G? 

+ G^LRG^ + KD (A-A) ? (LR) ~Vk 

and (Al8) <=> A > — ((XKL) - X^) (after applying Lemma 1) 

while (A19) <=> 

Q > gJlr + (A-l )R 1/2 [2A-(X+L) + jfV 1 R 1/2 (A-L) )g^ 

A A 2 - 1 m a 

+ KB (A-A) (LR) ¥k 
( after applying Lemma 3) 


(A18) 

(A19) 


(A20) 


(A21) 
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Lemma 5 


Leb A be a stable matrix, Q > 0, and K > 0 ba the unique solution 
to the Lyapunov equation 


then 


KA + A K + Q « 0 


X (K) < 
max — — 


A (Q) 

max M: 


2 min tx (-A)x] 
x/o 


X . (K) > 
mxn — — 


*1? 

x x**l 


X . (Q) 

min — 


fjjl 

2 max [x (-A)x] 


x^o 

;v.i 


Proof 


We have 


K(-A) + (“.£> JS^Q 

m ** ~ m** m*'' 

X (K(-A) + (~A) K)x ~ x Qx 


V x-/0 , x T x=l 


/(K(-A) + (-A) T K)x < X (Q) 


Vx^O, x T x=l 


Now chose x—x j- 0 such that 

Kx 55 X (K) x, 
— — max — 


~<X~ 

X X=1 


28 




Then 


,**T 


2 \, ax ^Hi (-A)|3 < A_(Q) 


max 


Now 


min 

x^O 

T 

X X®1 


X T (-A)x < x i (-A)x 


so 


2 \ (K) 

max — 


( min tx T (-A) x] ) < 

' X5^0 f 


x^O 

m 

X X»1 


A (Q) 

max *• 


or 


X (K) < 
max — — 


A (Q) 
max * 


2 min [x J (-A)x] 
x/0 

~T -i 

x x=l 


Similarly, we can write 


tft ** ** rrw 

£ (K(-A) + (-A) K)x > X min (Q) 


★ * 

and choose x ^ 0 , x x «l s.t. 


*V ^ IV ^ 

KX = A , (K) X . 

— mxn — 


X^Q 

1 

x X«1 


Then 2A . (K) [x^-Ajx*] > A . (Q) 

m i r * 1 ** J „ W 4 •% I*' 


and 


nun 


X . (K) > 
mxn — — 


mm — 


A . (Q) 
nun ~ 


2 max [x (-A)x] 
X^O 
T , 

X X~1 


Lemma 6 


Lot 


with 


“o ■ WV “ x m« (a ' 1/2 A:&V& 1/2 > 


K* (A + HC T ) + (A + h/) V, + Q + G RG® « 0 
— * — — — —o— -*••£ — —o—o 


Then 


..Tv 


vs < A (K) * • .J^S-LJrl 

' O - min- , „,.T. ...J_ r_T 


max r t. „ ,„„T. , 
t* (-(A+BG q )xJ 


m l n (£*'<- (»%S T >*1 

x^x*! 


Wi’s*®* 


X min<8> 


Pr oo£ o£ Luimna 6 
We have 


K f [- (A-HI o C T ) 3 + C-(A+H o g r )] T K f * Q + G^RG^ 
K[- (A+Bg£) ] + [- (A+BG^) ) a K « Q •!• GJR<£ 


so from Lemma 5 




X (Q+G RG ) 
max — — o — o 


2 min 
x/0 
"T , 

X X ~1 


[x* (- (A*I‘H C T ) ) x] 
— — — o— — 


X . (K) > 
ram — — 


X . (Q+G RG T ) 
ram — —o—o 


2 max [x T (>-(A+-BG T ) )x] 
VO “ ° ” 


T i 
X X »1 
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and hence 


X (K. 
max *»•£ 


, /« , /■* nrfi \ X T (- (A+BG T ) ) X 

t,i < l A-i r ~ j 

X X® 1 J 


X . (QIG RCT ) 
itan "-o — x> 




We also have 


w » X (r“ 1/2 b 1 ‘k q“ 1 k br " 1/2 ) 
o mux — •— *-*&"• 

5 K*v (K fQ*" 1 iif ) \„n* ^ BR " 1bT ) 
max *~*£ max — — 

i I WV i Xi„ t &> , "\ax ( B'V2> 


Hence , 


yj/w < X (K_)\J 

T o — max — £ 


^ n m 

X (R X B B) 
max — 

\#in^ 


This and the bound on X (KJ establish the Lemma, 

max •-£ 


P roof of Proposition 1 

A 

If A 2 A then by letting L « at, a > 0 the conditions in Lemma 4 becomes 
(i) 1 


A > \ ( ( 1+a) i - x" 1 ) 

— 2 — —O 


(U). 

Zt ”0"* — o *— O 

(iii) ' q > (^{ct_R ■)• r 1/>2 (A-ai_) t2A-(l+a)i + >T 1 ]’’ 1 (A-ai_)R 1//2 

A 

By choosing Q sufficiently large (positive definite) and by letting 
a *»■ 0, conditions (ii) ' £5 (iii ) ' are always satisfied while condition 

(i) ' ■* A > ~ (I - if 1 ) . 
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Pro o f o£ P roposition 2 

Let Q • 0(0^ + S 0 BSq) whore 0 > 0 is chosen such that condition 
(ii) of Lemma 4 iu satisfied, i.e. 


3(2 + 9. mV a z 1/2 [l+ xfj” 1 R 1/2 G T . 

m O *^"0 ***0 f *~ *~*Q 


(A23) 


Then K ** 0K_ > 0 

»«?si r m*z 4* 

% 

where is the unique Lyapunov solution of 

K f (A + .HC a ’) + (A + H/) T K f + £ + £ g RG* - 0 
Let L « ai, a >0. Condition (iii) in Lemma 4 then becomes 

0(Q - K-B(A-A) 2 k'VkJ 

**“* Ut **w*J»**w **• «J*69 **:a «n»£ 

+ orCtMOR « R 1/2 (A-ai) [2A-(l+a)i + ^ 1 r 1 (A-ax)R 1/2 }G^ > o 
A sufficient conditions for (A25) to hold is therefore t 

>i 


(A24) 


Q. > “ K f B(A-/t) 2 R” VlC f 


(3-a)£ - (A-ax_) [ 2 A- (i+a) i + jT 1 ] " 1 (A-ai_) > o 

The condition Q > 0 and Lemma 1 can now be used to show that 
(A26) <»> 


(A25) 

(A2$) 

(A27) 


or 


(R" 1/2 B*^“ 3 ^BBf 1/2 )*' 1 > | (A- A) 2 
(W )“ 1 > | (A-A) 2 

~*0 (X 


A sufficient condition for (A29) is 


3 " 1 < 4 r 4> 2 

o 


(A2B) 

(A29) 


(A30) 


(A3X) 


whore w » A { W ) , If wo now Lake 

U THirlA y 

4 

B * f* o t ft « 1/B 
Then (A30) becomes 



but from Lemma C, 


A « 

> (A- A) 2 


(A32) 


1 

varies as 

V5T 0 




max . T , , T. , 
t-x (A+BG )it] 

U ' «.*»•* T * 

<o irw — 


(A33) 


A 2 

so if this ratio tends to infinity then ( A-A) may become arbitrarily 
large. 

Moreover; from (A31) , a ->■ 0 and $ *> «, so the conditions (A23) 
and (A27) aro satisfied for all A s.t. [2A-(l+oc)I, + is finite. 

The only remaining condition of Lemma 4 is Condition (i ) , which tends 
to 5 

A > *” { (1-kx)i - x” 1 ) ►A > ~ (i - x” 1 ) 

^ ~'Q ~~ 4 ’** “~0 
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Proo f of Pro position 3 

Prom the proof of Proposition 2, the following conditions are 
sufficient for (*) to bo stable: 


(a) 

A > 4 ( (1+a) x - x" 1 ) 

— 4 — 

(A34) 

(b) 

w" 1 > | (A-A) 2 

ot *-•* *** 

(A35) 

(c) 

(3-oQX > (A-ai) UA - (1+a) I + x" 1 )’' :i (A-aX) 

(A36) 

(d) 

S(g + G^) > G c R 1/2 [I + x; 1 ) -1 R 1/s c£ 

(A37) 


To simplify tho proof consider first the case JWXjC/ X > 0, and 

A 

A «* t I, Xf we choose a » X, then conditions (a) -(c) become 


(a)’ 

X X > (I - x” 1 ) 
w ***0 

(A38) 

(b) » 

„-l > B.tt-lj 2 . i 
—o X 

(A39) 

(O' 

0 > X 

(A40) 


Sufficient conditions for (a)' -(b)' to hold are: 


X > (1 - --) 
*o 

w < — — , 
BU-1) 


where x„ 
o 

where w 

o 


■ max X(X ) 
o 

« max X (W ) 


(A41) 

(A42) 


To find the upper bound X of given (A40) , (A41) , (A42) and (A3 7) , set 

*T* 


3 « X, 

Hr 

Then (A42) yaeAde 


(A43) 
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0 ( V X) 


(A44) 


X n 1 + > 1 

We at', ill need to check that (A37) is satisfied, i.o. 


(A45) 


A(0 + G Rc' r )> G R 1/a [l + x ” 1 ]" 1 ?y z G T 


(A46) 


It can be shown/ abbeit with soma amount of algebraic manipulations 
by applying Lemma 1 and 3, that a sufficient condition for (a 46) is: 


X > --H—- 

* il+x o ) 2 


(A47) 


since 




< 1 and A, > 1, (A47) is satisfied. 


To find a lower bound A^of A, we first find tho lower bound A^ 
given by equation (A42) , We have 


W ° A (A* -l ) 2 

*jo mm 


(A48) 


It can be shown, after some algebraic manipulation, that A_ « A/A \A49). 
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Since X must also satisfies the lower bound given by OVID , therefore 
have 

(A50) 

■to have thus shown that (*) is stable for all A * Xl (and A = I) such 

that 


, A 

X * max 


(1 


--) , x' 

x o " 


X < X < X x (A51) 

— + 

where X + is defined by (A45) and X^ by (a 50) . The generalization to 
the case 

X_I < A < X + I (A52) 

for general diagonal A is obtained by replacing choice of L - otjC by 
a general L > Q_ as provided by Lemma 4. We shall omit the details of 
the proof of this as it is straightforward (albeit tedious) . 


Proof of Proposition 4 

Consider the Kalman filter Riccati equation: 


l (A + h/) T + (A + H^C* 1 ’) l + I C 0" 1 /I + $ = 0 


(A53) 


<=> 


+ h/) t r 1 + + h o c t ) + c e" 1 c T + r 1 * r 1 = j> <a54) 


If we let Q = 0(cO*" J 'C i + I L ^ Z X ) in Lemma 4 (such that Condition (ii) holds) 


•>-l_T . V“1 v~l 


then 


-1 


K ~ $K 

and Condition (iii) in Lemma 4 becomes 


(A55) 


c 
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1 

- 


i uoofV ... r\ r x y> « h V3 mr i/ ^ * I r x *<th 2 * x £r l ™&) 


whore , by letting Ti *• ul, u > 0 


M A ax t (A-oaj [2A-(Ma) i + sT 1 )"* (A-ai) 0 


(AS7> 


if 4» « ♦, + 4> » H b t 
— —I 2 • * 


(A58) 


Then (AhO) <•-»> 


"V + )’ _1 '!' )' _1 ) ] -|G R l/4 MH J/ V) 

i* ^ « 4 ****** »-(> 


1/2 M 1/2 T . 


r 1 « (* 2 b - 5 (a-a) 2 r- 1 ) b* r 1 > o 


(b> a o) 


(A59) 


If we take a « 1/H, anti lot <|> 2 *>• 00 , P *»■ «• in such a way that 

2 a 2 

tj) 2 /P «, tticm in the limit (A59) is satisfied for all (A-A) and A 

finite and Condition (4,1) of Lemma (4) tends to,. A > ~ (I - X 1 ) . 

— 2 — — o 


Proof of Proposition 5 

By Lyapunov theorem, the dynamic system 


x =5 A(t)x(t), t etO,«) , x(0) given, finite 


(A60) 


is stable (x(t) •* 0 as t ■> ~) if there exists a positive function s.t. 


1) v(x)> 0 x / 0 


(A61) 


^ 4r (i(t))> 0 t L. (0 ,k>) and x(t) satisfying (AGO) 

tit 


(A62) 


If we now consider the function 
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n: 


~ VT •* ~ 

“ X x K X 


where K is the Lyapunov matrix (a63) 


as defined in (A5 ) . 
then 


(i) n > o 


x / 0 since K > 0_ 


and 


’ iT ■“ ~ ~H ~ i 

(2) ^ * J5 * ^ * i$ * 

«s*T *v **' ^ *V <V ** 

“25 (A iS + _K. A)x (where A * A q *•* fiA a3 defined in 


(A64) 


equation (A4) ) 


» -x T fig x (from (A12)) 


(A65) 


<0 x i- 0 since fig is guaranteed to be > 0 

in each of the propositions 1 to 5, 

according to Lemma 4 , 

Hence, r) satisfies the stability theorem. 


Proposition 5 is proved. 
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ABSTRACT 


The purpose of this thesis was to investigate some inherent properties 
of hybrid systems. These systems include both continuous in time and discrete 
parts and have a particular importance in design and implementation of various 
digital control algorithms. In particular, problems of hybrid approximation 
for continuous "nominal" system and robustness of hybrid systems are studied. 

The robustness problem for general control systems has been studied by 
M, Safonov but his results cannot be applied directly to hybrid systems in 
order to determine a critical value of the sampling interval which assures 
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The practical three-dimensional control system is shown in order to 
illustrate the general relationships obtained for hybrid systems. 
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INTRODUCTION 


The subject of this thesis is investigation of some properties of hybrid 
systems, Such systems include both continuous (plant) and discrete (digital 
computer) parts, inherent properties of hybrid structures are of particular 
interest when designing digital and analog devices to be used in closed-loop 
systems (control systems, for instance). 

The first section provides a general description of hybrid systems, their 
components and introduces some notations. 

In the second section a continuous time representation is shown for the 
hybrid system. Examples given in the section explain general features of a 
hybrid structure, 

The third section of the thesis deals with properties of the induced 
norm of the hybrid operator. Both lower and upper bounds for that norm are 
derived. Their dependence on the sampling averaging interval is clarified as 
well as their impulse-like behavior. 

A hybrid approximation of continuous operators is considered in the 
fourth section. An optimal approximation criterion is discussed and inter- 
preted. The optimal coefficients of the hybrid approximation are derived for 
a sufficiently large class of linear continuous operators. Possible structural 
simplifications both in sampler and hold circuits are discussed and the opti- 
mal approximation for these situations are derived. Some examples are shown 
in the end of the section. 

The fifth section of the thesis deals with the robustness problem for 
hybrid systems. This problem has been solved in general for various control 
systems but either for continuous or for discrete case. Those results are 
used to develop an appropriate sufficient stability conditions for hybrid 
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systems. The approach suggested for this purpose i^rovides the value of 
sampling rats which preserves stability of a nominal continuous time system. 

The last section describes an example of the concepts and methods de- 
veloped in previous sections. A three-dimensional single input-single output 
closed loop control system is considered. A sampling rate which assures 
stability of the corresponded hybrid system is found by the suggested method. 
The optimal approximation hybrid system is constructed and compared with 
alternate hybrid system. To compare their performance when subject to noise, 
both systems have been simulated on a computer. Results of the simulation 
are discussed. 


SECTION 1 


HYBRID SYSTEMS 


Consider two general linear operators 


v (t) - J G(t,Q)u (0)d0 


v K (t) * 


( 1 . 1 ) 

( 1 . 2 ) 


*«1 


where u(Q), v(t), VjJt) are vectors of dimensions M, N/ l>, N, respectively, 
G(t,0) is an NxM matrix and G^(t) is an LxM matrix. 

Tho operator (1,1) represents a physical continuous time system, while 
(1.2) is a system which includes both digital and analog components. Systems 
of this type will be called "hybrid systems". Usually, they have the follow- 
ing structure. 


u(^)J analog/digital 

CONVERSION 


DIGITAL 

COMPUTER 


digital/analog 

CONVERSION 



Pig, 1 Hybrid System 


As seen in the Pig, 1, both input and output of a hybrid system are 
continous time signals. Such systems may be connected directly with various 
continuous time plants for different purposes. 
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ft hybrid system consists of throe ports: sampler, computer and hold 
circuit. 

a) sampler is a device which converts analog signals to a sequence 
of numbers (vector-valued) getting to a computer. 





SAMPLER 

* 

COMPUTER 


\ 


Pig. 2, Sampling Operation 


The input signal u(0) is averaged in some way over time interval t so 
that each t seconds a new value of E gets to the computer. This opera- 

r 

tion over a single time interval from (A-l)x to Ax may be represented as 
Ax 


e, - J f « (9)u (O)d0 

* (A-l)x % 


(1.3) 


where f^(0) is a certain matrix valued function, u(0) and are vectors. 


We define f^(0) so that 


f^(0) * 0 if 0 0 (x (A-l) , xA) . 


b) Digital Computer . This block performs transformation of input 
sequence {£.} , A = 1,2,.,. into output sequence {n } , K * 0,1. . . . In case 
of linear realizable system it may be written as 


4 




Fig, 3, Sampling 


Z v 5 . 


(1.4) 


A-l 

where is an fc-vector, n k is an -vector, and is an L^xL matrix 
sequence, 


c) Hold Circuit . The input of this device is the sequence {r^} which 
can be multiplied by some continuous function g^Ct) over each interval 
[kr, (k+l)T) to produce the ultimate output of the hybrid system v k (t). 


v k (t) - g fc (t) • n k 

where g k (t) is a NxL^ matrix and is also defined to be zero outside the 
interval [kr, (k+l)T) . 

Finally, the overall hybrid system which transforms u(9) to v k (t) may 
be presented in the form 


5 



SECTION 2 


Hybrid Operator Representation 


In this section we show how the hybrid system may be presented in a 
continuous time operator form. This representation allows us to investigate 
some specific norm properties of general hybrid operators and also is help- 
ful in applying methods of continuous time systems to hybrid controllers. 

The transformation (1.5) may be written in a continuous time form 


v (t) 



G(t,0)u(0)d0 


if we introduce the function 


( 2 . 1 ) 


k 


3<t,e) - 9 k (t) 2jW e > 


( 2 . 2 ) 


JWL 


and let k “jjJ ke t ^ ie integer part of ~ . This is verified by using ex- 
pression (2.2) in the formula (2.1). We have 


t 

/■ 


k 


v(t) = / g k (t) y p kjl f jl (6)u(e)d0 » 


kx 


■ % (t) 


Ev J 

&=i o 
k S,x 


f ^ (0 )u (0 )d0 “ 


(2.3) 


= »*<*> Ev / u 


(0)d0 = 


(JL-l)x 


g k (t) - v k (t), k - 0,1.. 


A=1 
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The result shows that any hybrid operator (1.5) may be presented in a 
form (2.1) with a weighting function (2 .2) . Also, one can see from the expres- 
sion (2.2) that the hybrid operator is inherently factorized into two factors: 


one depends only on t, the other only on 0. 

Usually, shifted versions of the same function are used both in sampling 
and hold devices, i.e. 

g m (t) " (t-mt) 

(2.4) 

V 0) * v 0 “* T > 

where m and A are arbitrary integers, and g Q (\) and f Q (X) are given sample 
and hold functions. 


Example. 

Consider the following example of a scalar hybrid system 


Sampler: 


Computer : 






< A < ° 
otherwise 


(2.5) 


Hold: g Q tt) “1, 0 <_ ,\ < T 

Formula (1.5) yields for G(t,0): 





8 


whoro 


0 

r.„ - f / uiOdO 

-r 



Fig, 5 shows a structure of the function G(t,0). In this particular 
ease functions g ( 1 (A) and £ Q (A) ate shown in Fig, 6, They represent so called 
"zero order hold" and approximate "impulsive sampling", respectively [l] , 
another possible example of a sampling function is 


£ n (A ) 


m 


i 

c 


o 


-oc\ 


(2.7) 


1 

a 


, CtT 

(o - 1) 


g 


I 




Fig. 6. Example of Sampling and Hold Functions 

This is called exponentially weighted sampling and also approximates impulsive 
sampling for a sufficiently large. 



Fig. 7. Exponentially Weighted Sampling 


In more general situation functions f Q (l) and g Q (X) are not necessarily 
scalars. For example, the samples might be 


=3 I I 

\ f 20 W) / 


10 


whore £ (X) and £ (1) arc scalar functions shown on Fig. 8. 

1U ** Vf 




Fig. 8. Example of Multivariable Sampling 


f io w 


f 2 o (X) 


j 1 -T < X < 0 

| 0 otherwise 


1 4 ♦ i) 

i. 


( 2 . 8 ) 


-T < X £ ° 
otherwise 


In this case £ samples the average value and samples the average slope 
of the input function. Similarly, the hold circuit may have the form 


g Q (X) =■ (g 30 (X), g 20 (X)) 


where g^d) and g 2Q (X) arc ' ^ OE exa, "pi e 
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Here , 


*10 w 


9 20 M 


( 1, 0 < X < T 

0, otherwise 

! yX. o £ X < t 

0, otherwise 



Pig. 9. Example of 
g 10 is a zero ordor hold and g^ 



0 T 


Multivariable Hold 
. is an ideal first order hold. 


( 2 . 9 ) 


X 


The 


computer can then command both the. level and the slope of the output function. 


I 




SECTION 3 


Norm Inequalities for Hybrid Operators 


Now we establish upper and lower bounds for induced norm of the hybrid 
operator . 

A norm of operator G is defined as [2] 


|g| | - SUP 


|Gu| 


u 


u 


(3.1) 


where ||u | is a Euclidean norm of a vector function 
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||u|| 2 * f u T (0)u(0)d6 


(3.2) 


In the case of our hybrid operator we have 


(Gu) (t) « g k (t) / >Oi.nC n 
~ a l 


(3.3) 


where 


/ 

U-l)t 


5^ - f f a (6)u(0)d6 


With g (t) , £^(9) are matrices and is L,u(6) is M dimensional vectors. 


For such operators wc can write 


1 1 G 1 1 2 - SUP ■U —j-L 


(3.4) 


u u 


= SUP 


UP — f (Gu) T (Gu) 

u INI ,r 


dt 
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,* 


i 


/ 


* (Ktl)T 


(Gu) T (Gu)dt 


2/ 

k«0 kx 


(Gu) (Gu)dt *» 


00 (k+l)x 

E/ 

k-0 kx 


t*tg k (t) > 


/Fk^)t # 53m D kjn g k (tlMt 
t-T m*l 


Define 


(k+l)x 

\ ^ / 9 I <t)5 k (t>at 

kx 


Then, 


go 

IMI 2 -V 

k»o 


1=1 m=l 



trjD, ? 5 *d?«] 
1 km nr ft kx 



D km J 


tr[ Vl ! 


Due to properties of a trace, we have 


< tr ‘V^> 2 <iigi 2 • ngi 2 

and 


( 3 . 5 ) 


( 3 . 6 ) 


( 3 . 7 ) 


( 3 . 0 ) 
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“'Vi 1 iiigi • ngi 


(3.9) 


So, 


09 

I M I 2 <y^tr[A k : 
K-0 


1 Hlj 

A*1 m*l 


(3.10) 


Properties of matrix trace? used in (3.7) ~ (3.10) are given in Appendix II. 

Quantities trtA.] and tr [D^ D^] are independent of u(0). Further in 
this section we will restrict ourselves to the sampling function 


( | P -e < A < o 

f Q (X) * / e (3.11) 

/ 0 otherwise 

where p is a constant LxM matrix in order to obtain a simple result. However, 
as E-+-0 the result is still true no matter what the shape of the function 
f Q (X) is inside the interval [-e,0). 

Under these assumptions, we get 
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< tup 


._i JL . 


h M 


» Hull 


2 2 



ij 


Til 

/ 

ll-C 


(0)d0 * 


r 2 LM pnrL 1 
— - — sup ■”*— 

£ u llu 


Zi 

3»i Til -e 


Uj 2 (0)d0 


whar© r m max max 

i j u 

The expression (3,12) may be simplified because 

m til MO 

L/ U 2 (0)d0 J* u 2 (0-x5.)d0 * 

j»l Ti«e 2*? 4: 


f » 

I U (0 -Til)U 
-e 


(0«TS,)d0 


Then, 


y u t (0-TJl)u(0-Til)dO 
-e 

sup — 


w 1 


(0)d (0) 


for £“1,2, ... , Therefore, for the hybrid operator norm we have from 


‘ii 2 iX} 


k k 

“tv '5ZZJ ;rID w D i« 1 

k^O m«*l 


2 A? 

r LM 2i_ 

e — e 


and 


(3,12) 


(3.13) 


(3.14) 


(3.10) 


(3.15) 


(3.15) 
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( 3 , 16 ) 


2 Z/ trID M- V 

%ml m«'JL 

is not necessarily finite. One could conceive sequences A k and so that 
the upper bound of the hybrid operator is infinite 

In order to obtain a lower bound for the induced norm of the hybrid 
operator we may select any particular input u (0) and consider the corresponding 
value of 

ll cull 

INI 

as a lower bound of the operator norm. 

We select 

! $ t-e <, 6 < t 

0, otherwise 

where 3 is a constant M-vcctor. 

Then, for (Gu) (t) we obtain 
k 

(Gu) (t) « g k (t) (3.17) 

8*1 


11=11 i"= 

JT 


We note that 


00 


R 1 ■ 


k"0 


where 


Ti 

- J f A (0)u(0)d0 

tJl-e 


| p 3 , & - 1 

) 0, otherwise 
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and therefore, 


k 

(Gu) (t) ■ £g k (t) Yp^ p p « y k (t)D kO P0 
Jt«X 

m 

IWI 2 .£wV ‘ tr[D kO D kO J ' ilPSlI 2 

k*0 


( 3 , 18 ) 


(3.19) 


00 

ll.ll*. 

0 

Then, 


(3,20) 


iuii 2 

Hull 2 




(3.21) 


The conclusion of this analysis is thsst the norm of a hybrid operator 
with interval sampling becomes unbounded as the interval sampling becomes un- 
bounded as the interval vanishes (tends toward impulsive sampling) . This 
means that the impulsive sampling has this specific norm property in spite 
of the fact it is widely used as a simplest modal of the sampling operation [1] . 
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Pig. 10. Norm Bounds for the Hybrid Operator 


SECTION 4 


Hybrid Approximation of Continuant Operators 


At we have shown in Saction 2 the hybrid operator in ganaral, may be 
represented in a form 

k 

G(t,0) * g Q (t-k'n (4.1) 

t 

where k it the integer part of / and 
t 

(Gu) (t) * J G(t,0)u(0)d0 - 



k 

g 0 (t-kT) Vp H f 0 (6-Tr,u(e)d8 
Jt»l 


k Tf 

« g n (t-kt) P k£ J f o (9-TJl)u(e)d0 
£*1 fW-1) 

k 

“ V t - k '° Yfah 
&*1 


(4.2) 


The problem of optimal approximation of a continuous time linear operator 
<3(t,0) by the hybrid operator G(t,0) may be formulated as follows: 

Find the structure of a hybrid system, i.e. matrices g Q (X), D k ^, fg(X) 
such that 

J * Jim 

ip-K» 


T t 

/“/ 


tr [ (G (t,0) - G(t,0)r (G(t,0) -G(t,0))]d0 


(4.3) 
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is minimized , 

Physically we can interpret th# criterion as a mean square deviation of 
signals v(t) and v^(t) produced by the nominal and hybrid systems# provided 
that both are driven by th# same white noise process. 

To prove this we note that the two system responses ares 


v(t) 



G(t,eiu($)a$ 


v k (t) 


j G(t,6)u(6)cffl 


Then, 


v k (t) - v(t) 



[G (t ,0) 


- G(t,0))u(0)dO 


( 4 . 4 ) 


E[(v k (t) - v(t)) (v k (t) - v(t)) a ) 


■v 

"I// 

■// 




(G(t,0) - G(t,0))u(0)d0 * #u (M)(G(t,W) - G(t,W)) d (0 


d0d(u[ (G (t,0) - G(t # 0))(G(t # fi>) - G(t,W)) T ]u(0)u T (co) « 


dGdW[ (G (t,0 ) * G(t,0)) (G(t,«) - G(t,W))E[U(0)u T (CO)] 


t 

« J (G(t, 


0) - G (t.0 ) ) (G (t ,0 ) - G(t,0)) X d0 


( 4 , 5 ) 
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A natural measure of total deviation between two time variant random 


vectors is 


J - Bilim | 

T-H» 1 

Subsituting (4.5) 


} 

I tr[(v k {t) -v(t))(v k (t) - 

into (4,6) we obtain the criterion (4.3) 


(4.6) 


Perfectly matched hold 

Suppose now that the nominal continuous operator is such that 

G(t,0) - H(t)S(0) (4.7) 


where H(t) satisfies a functional equation 


H(t l + V " H(t l ) * M(t 2 J (4.8) 

for some matrix M(t) of dimension KxK. We can then look for optimal approxi- 
mation matrices in the form 


D kfc ~ M k ’ d £ 

where the M^'s are KxK and d^'s are matrices. 

The hybrid operator (4.1) then takes the form 

k 

G(t,0) = g n (t-kT)M^ ^ d„f (0-T&) 

and we can identify g (t-kx) and M. as 

U K 

g Q (t-kt) m H(t-kT) 

M, = M(kT) 
k 


(4.9) 
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This identification means that tha t -dependent factor of the nominal 
operator may be duplicated exactly by the hybrid system for all t. Now call 


Now call, 
S (6) 


0, 0 > kT 

k 


£ iVo <o-rt> , 0 < KT 

and substitute into the criterion (4.3). 


*/-/ 


. T T . 


13m jjj- / dt | tr[(S(0) - S(6) ) V (t)H(t) (S(0) - S(0))]d0 

rp4co 

0 0 
T t 

« lim £ # dt / trtff^tjHtt) (S(0) -S(0))(S(0) -S(0)) T )d0 


0 Q 

T ki 

im I* J H T (t)H(t)dt J 


“ trtlim 

T-K» 


kJ 

(t)dt / (S0 - S(0)) (S(0) - S(0)) T d0 + 


+ / S(0)S T (0)d0}] 


l 


- trflim 
N-k*> 


N (k+l)T k Ax 

»£ / E / ' 

k=0 TcT A=1 (X-1)t 


(S(0) - S(0) (S(0) - S(0)) T d0] + 


N (k+l)T 


« lim 
N**» 


N 


^Mbr[ / H T (t)H 
k=0 Jcc 


(t) dt 


k At 

•E / 

A=1 (A-l)T 


(S(0) - S(0))(S(0) - S(0)) T d0] + J 


(4.11) 


where 


N (k+l)T t 

J - tr (lim J H T (t) H(t)dt . J 

N 1>00 i r\ l.<r 1 




k=0 kT 


(t)dt * J S(0)S(0) d0] 

kT 
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when? 


»L“ ib »L J ls(0) 

k«0 (i-l)t 


- s( 0 ) ) (S( 0 ) - S( 0 )) tlOJ 


/ 5 


(t)H(t)dt 


(4. 


Since each term of this double sum 

(sc®) - s{0j> (s‘ca)-s’C0))*aai (4. 

1)T 

depends only on its own matrix of coefficients d^ and not on other d^ (m^l) , 
it can be minimized independently over d^. It corresponds to a single 
square optimization shown on Fig. 11, 

J k& Mtrt \ / (S(Q)S T (0) - 2S (0 ) (0) + 8(6)8® <0))aO 

(a-i)x 



S{0) * d 0 f _ (0-XJl) 


for tU-1) < 0 < XI 




J k A " tr[B k / { W 0 “ T * )f o (0 " U)d A “ 

(A-l)T 

- 2d^f o {0-TJl)S T (0) + ?(0)S T (0))dO) 

Introduce following notations 
At 

fJ j f o (0-TA)fg(0-TA)dO 5 P Q 

(A-1)t 

At 

4>A “ j S(0)f T (0-TA)d0 

(A-l)T 


Then, 


J kA 


tA 

tr [ B k (d^d* - 2d + J 6 10 ) S 1 <0 ) d0 ] 

T (A-l) 


Using formulas IA and IB of Appendix, we come to the equation 


9J 


kA 


“ 8u< d 0^n “ “ 0 


9d A kA 0 


and 

d A = Vo 

if F q and B^ are invertible. This implies that the optimal hybrid 
approximation is 

k 

G(t,0) = g Q (t - kT)M k J <|> Jl F“ 1 f o (0-TA) 

A=1 


( 4 . 14 ) 

( 4 . 15 ) 


( 4 . 16 ) 

( 4 . 17 ) 
operator 

( 4 . 18 ) 
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where 


g Q (t-kT) • M R - H(t) 


Consider now the special case 


G(t,6) - 


(4 19) 


where A is NxN matrix. Then (4.7) - (4.8) imply that 


At 


H(t) ® Ce 


S(0) * e' A0 B 


(4.20) 


and from (4.9): 


M, » e 
k 


Akt 


g Q (t-kT) « C e' 


A(t-kT) 


(4.21) 

(4.22) 


Suppose, we also define 


f Q (0) - e _A0 B 


(4.23) 


Then, for F Q and we obtain by definition (4.15) 


» J f o ( 0 )f o (0)d0 52 /•** hbV*®* 


-T 


-t 


Six 


h~ f S(6 )f X 0 (0-til) d0 * J S(0+T£)f£(0)d0 


-T 


0 rh 

-AT A f -A0 _ 0 T -A 0 , ft -AtA^ 
= e I e BB e d0 = e F. 


/ 

-T 


(4.24) 
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F Q is full rank if (A,B) is controllable [1] . The formula (4.17) yields: 


. _ A "AT A 

d A “ *JL P 0 S 


and the corresponding value of j ^ and, consequently J-J, is zero. 

For the hybrid operator we then have 

k 


G(M) “ g 0 (t“k )m v y"]a g f n (0-r&) 


A“1 


— ...... . . r » *v k ■ v 

* ce e o / e e e b 


^ At _ -ATk.AkT -AT -A0 _AT& 

Ap»1 


k 


„ AtV' -A0„ . /fi . 

» Ce / e B 1^(0) *■ 

JUl 


|C e A(t “ 0) B, 0 < kT 

|o otherwise 


The function 1„(0) ia defined as 


V e > - 


1 (Jt-l)T < 0 <_ Ti 
0 , otherwise 


The output of the hybrid system is 


/' 


(Gu) (t) == / G(t,0)u(0)d0 = 


kT 

= J C e A(t_0) Bu(0)d0 * 


kt 

/ 


G (t,0)u (0)d0 


(4.25) 


(4.26) 


(4.27) 


(4.28) 
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This result means that a continuous time linear time invariant nominal 
operator may be exactly approximated by choosing appropriate sampling and 
hold structures! except for an inherent sampling error in the "triangle strip". 
This is illustrated in Pig. 12. 



Note that the optimal sampling and hold circuits required by 
and (4.23) are themselves multivariable linear systems of order N. 
takes the form 


}T 

h~ f eA 

(X-l)T 


Ut-0) 


BU (9 ) d0 


(4.22) 

The sampler 


which has the block diagram in Fig. 13. 

The hold circuit has the block diagram in the Fig. 14. 
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Example 


a) nominal systems 


G(t,0) - Q 


A(t~0) 


b) exact match of hold, i.e. 


g Q (t) ■ H (t) * e 


At 


(4.29) 


M. * e 


AkT 


c) u(0) «* fy(0) 


(4.30) 


where y( 9) is a scalar function of time, f is a constant L-vector. 


d) f Q (0) = 


- e < 0 < o 


otherwise 


where I is an LxL identity matrix. How we can apply formula (4.17) to ob- 
tain an optimal but not exact approximation of the nominal continuous operator. 


/ 


F o = / £ o (9,£ o |9,ae “i 1 


(4.31) 


0 

/ 


,T 


<*>£=/ "S (0+TJl) f ^ (0 ) d0 - 


= e 


-AT#, 


0 

/ -A0 1 
6 ? 


d0 


. „-AT«. / -A0 -n 

a S. “ Vo ■ e ' e a9 


0 

/ 


(4.32) 


(4,33) 
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} 


The simplified sampler structure for this cas^ is shown in Fig. 15. 



sampled 


at t-r/ 


Fig. 15. Simplified Sampler 
This is equivalent to the structure on Fig. 16. 



at t=r/ 


Fig. 16, Sampler of Reduced Dimension * 

Note that if e goes to aero with finite T R k ■+ 0 , which means that the 

impulsive sampling produces signals which should be neglected under the optimal 

hybrid approximation. This result is natural since the optimal approximation 
30 



approximation y?as designed to match outputs of two systems subject to the 
same white noise# But the impulsive sampling leads to an infinite mean 
square deviation between the two samples, so the output should be supporessed 


by choosing d« so that 11m d„ - 0 in the optimal hybrid approximation. 

* e+o A 

Instead of the N -dimensional sampling circuit in Fig, 13 we now have a 
one-dimensional integrator in Fig. 16, 

The formula (4.17) provides an "optimal" computational procedure (con- 
volution) given an optimal hold circuit structure perfectly matched outside 
the "triangle strip". 

Perfectly matched sampler 

Consider now the dual case when the sampling operation is perfectly 
matched outside the "triangle strip" but the hold structure is unknown and 
to be determined. 

Similar to the above case we suppose S*(0) is such that 

S(e i + e 2 ) « d(0 x ) . s(9 2 ) (4.36) 

where S(0) is a KxM matrix. 

Then, 


s(0) *» S(0 ~t& + t&) = d(k&)S(0~T&) 


Since the functions f^fO-Ti) of the sum 



(4.37) 


do not overlap (by definition) , we can make the following identifications 


Then, S(0) ** S(0) for ail 0 <,HT. Now we can go back to the general criterion 
(4.3) s 


T t 

m lim r I dt / 

J J 

0 0 


tr|(H(t)S(0) - H(t)S(0))' r (H(t)?(0)-H(t)S(0)))d0 


lim 


lim 

OV** 


lim 

T-*» 


■/“/ 

»/-/ 


(H(t)-H(t)) T (H(t)-H(t))S(O))d0 


t*tS(0)S T (0) (H(t)-?(t)) T (H(t)-H(t)))d0 - 


/ k p 

at “E / 

l-i T (Z- 


S(0)S T (0)d0 


( 4 . 39 ) 


l-l T (A-l) 


(H(t) -H(t)) T (H(t) - H(t))l + J , 


T t 

y dt tri y 


J - lim ±- / dt tr[ / s(0)S T (0) (H(t)-ff(t) ) T (H(t) -H(t) ) )d0 

T-K° T , 

kx 


(k+l)T k 


J-J « 1dm 
T-x» 


E 7 at E 

k“0 kX X.*l 


dt ^ ^tr!C g (H(t) - H(t) ) • (H (t) - H(t) ) 1 


( 4 , 40 ) 


l 


A / — . 

C„ « 1 S(0)s (0)dO is a KxK matrix. As before, each component of 


>T, 


f(A-l) 

the sum over k depends only on value of (H(t) - H(t) )* (H(t) -H(t)) on interval 
kX < t <_ (k+l)T. So, we can minimize each term separately. 
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(k+X)T 


'k f dt ylr [Cft (H (t ) -H (t ) ) * (II (t ) ~H(t) ) ) 


k (k+l)x 


“ y 

A-X kt 
k (k+l)T 




S trtC^ A (B(t)4T(t)) T (?l(t)-H(t)dt) 
let 


k 

■B 

)t-i 


Jcfc 


This implies that quantity 


(k+l)T 


J kA " trIC 




>T 


(H(t)~H(t)) (H(t)-H(t))dt] 


is to be minimized by choosing H(t). 

Suppose we look for H(t) in the form 

H(t-kT) * g Q (t-kT)e k 


where g Q (t-kT) and e^ are NxJ^ and L^xK matrices, respectively. Then, 


J k* RtrtC A 


(^L)T 


(e k g T (t-kT)g(t-kT)e k - 


- 2e£g T (t-kT)H(t) + if (t)H(t) )dt] 


Introduce two matrices 

(k+1 ) T _ ? T 

, 5 f g„(t-k )g (t-k )at - fg 0 
0 k-f o J 

a (k+1) T _ I ip 

T|; k * C g^(t-kt)H(t)dt » r gJ(t)H<t+k )dt 

Vr«y O*' 


(t)g Q (t)dt 


(4.41) 


(4.42) 


(4.43) 


(4.44) 


(4.45) 
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HOW# 


(k+l)T 


T„ 


V ■ “1° <\Vk - 




II (t)H(t)dt)) 


kx 


3J 


kJl 


- 2T-0. C e -24c. * 0 


"oV* *^k W l 


(4.47) 


(see formulas IA and ZB of Appendix). Since is arbitrary# i.e. independent 
of hold device characteristics, we conclude 

«k - *l\ 

if if 1 exists. 

For the specific case where 


g Q (t) - Ce 
H(t) - C At 


At 


(4.49) 


we have be definition (4.45) 
T 0 - j /* o T Ce At dt 

v / /Tt ° T ' 


_ At AkT.. _ AkT 
C e e dt * T^e 


(4.50) 


The matrix T Q is full rank if (A,C) is observable 11] . Formula (4.48) then 
yields 
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e * e 

k 


AkT 


(4.51) 


ThiB result is expected; it corresponds to the case of exact approximation of 
hold device and has been derived before using simpler considerations (formula 
4.21). 


The general c~se 

In general, both the sampling aid the hold dervices may not be matched 
perfectly outside the "triangle strip". 

Given a desired structure for these circuits, i.e. functions f ^ (0 — T A) 
and g Q (t-k ), we might then be interested in determining a computational 
procedure (matrices d^ and e^) which provides an optimal (in the above sense) 
hybrid approximation of a nominal system. 

So, we have for the sampler and hold, respectively 
k 

S(6) -£ VqW ^) 

A-l 


H(t-kT) = g 0 (t-kt)e k 


The criterion (4.3) is 


(4.52) 


J - lim =- 
T-X» 


T t k 

k J dt / tr[(g 0 (t-kr)e k yi 

o o Jl=i 


Q (t-kr)e k >d Jl f o (0-kJl) - H(t)S(6)) T 


K 

• g (t-kT) e > d f (0-xS,) - H(t)S(0))]d0 = 
0 k £ mm j v b 0 


m~l 

T t _J<L 


- limi f ^ f tr[2j T o (0-TH)cl^(t-kT) - 

111+00 0 0 it=l 

. k % 

-S T (0)H T (t)) • g(t-kT)e k ^d m f o (0-Tm) - H(t) S(0) ) ]d0 = 

m=l 
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lira 


i. / at / tr .fTfr e-u, . d^(t-kT)9 0 (t-kT) a> 

0 0 A“1 m*l 


• d m £ o (0-Tm) - 2S T (0)R r (t)g o (t-kT)G k ^^ m £ o (0- Tm) + 

m*l 


+ sVjH^tnutjstondO 


Consider the sum 


k k 

^ ^ 1 fcr l f q ( 0 ~T £) d^e^g^ (t-kT ) g Q (t-kT ) . e^d^tO-Tm) 


m*l w*± 


k k 


E2>o 

m*»l E=T 


(0-Tm) . f* (0 -t£) d'Je^ (t-kT ) g Q (t-kA) e^] 


(4.54) 


Due to the definition (Fig. 3) of functions f Q (0) we can write 


f Q (0 -Tm) f q (0 -T ft) = f Q (0-T)l)f^(0-TJ l)5 mJl 


(4.55) 


Then (4.54) takes the form 


£ 

ft*l 


tr [f Q (0 -Tft) f * (0 -Tft) d^g* (t-kT ) g Q (t-kT ) e^J 


and for J we hav$ 


N k 


J « 


iim k 

N+oo 



m m 

tr [F d„e, T.e, d n 
- 0 ft k 0 k ft 


k=0 ft=l 


5? kc k 


- # t «K* 


k * f at J V s 1 '(0)!f l '(t) • iT 

0 u 


(t)8(0)d0) *♦• J (4.56) 


where as before, Cf is 


J * lim 

H'-Ko 


T t (4.57) 

I* f At f tr£(H(t)S(0) - H(t)S(O))' J '(II(t)S(0) ** H(t)S(0)))dO 


The quantity J- J is to be minimized by choosing matrices e^ and d^. 
now introduce a new matrix of computer coefficients 


We can 


°u * e k a d (,1 ' 5£l) 

its dimension is With this definition, J ~ J again breaks down into 

independent optimization squares with costs 


T 


J kA “ trIP o D kA,Vu - 2 h\ih ] 


(4.59) 


0J 


kfi. 


3d rr s 2 Vk f ’o " #*+* * 0 


kJl 


and 


D u - 


The overall optimal hybrid operator now is 

k 

g (t , 0 ) « g 0 (t-kr ) VD k ^ 0 (0 -xl) 


(4.60) 


(4.61) 


(4.62) 


whore g^ (t-k ) and f^ (0-T?) represent simplified sampling and hold structures. 
The simplification means either lower dimension of analog circuits or simpli- 


fied feedback loops or both. 
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The optimal hybrid system is shown in Fig. 17 


Utf) 

Convolution 
f 0 (9) « u(0+r/) 

=< 5 ^ 0 = 

k 

\ = E ^ 

=o'o= 

g 0 (t-kr) rj 



$ 

^ j I n ^ 

/* 1 

’'k 



Vk(t) 


sampled 
at t=r/ 


output 
at t=rk 


Fig. 17. Optimal Hybrid Approximation. 
General Case. 


Example . 

Single input-single output system. Suppose, 


’ G (t,0 ) *= Ce A(t " 9) f (4.63) 

m 

where A is NXN matrix, f and C and N -vectors. Let f ^(X) and g Q (X) be chosen 
in the form 



V M 



' I , 


-T <_ X < 0 

otherwise 

° <_ X < T 
otherwise 


(4.64) 


where x(6) is a scalar function. 
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Then, 


H (t) - Ce Afc f ST<0 ) « e“ A ° • £ 


. h. 
0 / x 


F„ « I x"(0)d0 • I 
-T 


Tq-T 


, ^AT£ f -A0 /a ., Q 

<P 0 " 6 I ® £ x(0)d0 


T 

/ 


■I, „ /- I At,. ATk -l y _ AT . AT 

Ip k ® C | e dt • e « -CA (I - e )e 


D « ■ T '\ V" 1 - 


T T 

/ 


1 n*~ l ir “ AT t -AT(k-£) 
CA \ I “* e ) • e 


J*x^ (0 ) d0 


T 

• f A0 


(0)d • £ (4. 


The expression (4.66) of optimal scalar sequence of coefficients is to be 
used in the digital computer of Fig. 17. 


SECTION 5 


Robustness of Hybrid Systems 

In Section 4 we have shown how continuous time linear operators may be 
approximated by a hybrid system. If this approximation takes place in a 
feedback loop of a closed loop control system, the stability and performance 
properties will degrade somewhat due to errors of approximation. 

The extent to which such errors effect stability has been investigated 
in general by Safonov PI* Sufficient stability conditions for continuous 
and sampled data systems have been established. In reference 14), simpler 
frequency domain conditions have been derived for linear time invariant Systems 
subject to additive errors of various kinds. A block diagram of these systems 
is shown on Fig. 16. L is a nominal time invariant operator, and AL is a 
perturbation or error, time invariant as well. 

Then, according to [4 ] , the system remains stable if 

aCi + L(jw)) > a(AL(jw) ) (5.1) 

Here L(J<4) and AL(jto) are transfer functions of L and Al, and CT(A) , a(A) denote 
maximum and minimum singular values of A. 



*>V'*** 



Figure 18 may be viewed as a general diagram for the spe.*^xc control 


system shown in Fig. 19. 



Fig. 19. Control System 

Here P and G are time invariant continuous matrix convolution operators. That 
is 

y (t) = (Pz) (t) = f P (t-X)z (X)dX (5.2) 

0 

and 

t 

v(t) = / G(t-X)y(X)dX 

{ 

P usually represents the "plant" to be controlled, and G is the ideal continuous 
time controller designed to regulate P. This system can also be drawn as in 
Fig. 20. 

It has overall operator PG: 
t 

(PGz)(t) = / PG(t-9)z (0)d0 (5.3) 

*6 
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.* 



Pig. 20. Control System 

- f- 

PG(t) • I G (t-0 ) P (0 )d0 (5.4) 

0 

is again a time invariant matrix convolution operator. Our objective in 
this section will be to examine the effect on stability caused by approximating 
the operator G with a hybrid system, i.e. what happen s if we use a digitally 
implemented controller? The tool i or this analysis will be the stability 
robustness condition (5.1). Unfortunately, the condition (5.1) cannot be 
applied directly to the approximated system because a hybrid system is inherently 
time-variant in nature. This follows, for example, from errors in the "triangle 
strip", as discussed in Section 2. 

However, if we construct a time-invariant "bounding operator" W with 
property 

|| w u || > || AGu|| V u (5.5) 

where AG = G-G , then stability condition (5.1) may be applied in a form 

0(I+PG(jW)) > CT(W(j(o) )o’(P(jW) ) (5.6) 
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for all oi > Of where W(jw) denotes a matrix of Fourier transfr* „ of w(0). 

We note from Fig, 10 that an optimal unconstrained hybrid approximation 
of a linear time-invariant operator satisfies 

G(t,0) - G(t,0) for all t > 0 and 0 < 0 < kT 

and 

G(t,0) « o for kT < 0 < t (5.7) 


Therefore, 


AG 


0 

G(t,9) 


if 


if 


0 < 0 < kT 
kT < 0 < t 


( 5 . 8 ) 


i.e. Ag^O only inside the"triangle strip". 

The approach may be suggested to construct the operator W for general 
multivariable systems. This approach provides a rather conservative upper 
bound for | | AG | | . 

For (AGu) (t) we have 


(AGu) (t) 



G (t-X)u (X)dX 


( 5 . 9 ) 


■-L 


(AGu) (fc) / I G (t-X)u (X) dX 


< j 0 [G (t-X ) ] I |u (X) I |dX 

kT 


( 5 . 10 ) 




< C | I | u (X) ( | dX 
kT 


where C - max O‘[G(0)]» 
O<0<T 
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»(A) i* ft maximum sinqular value of A* Th«n, 
| j AGu| | 2 * f || (AGu) ( t) | | 2 dt ■ 


» (k+l)x 


E / | | (AGu) (t) I | 2 dt £ 


k*0 kT 


» (k+l)x t_ 

2 


c 2 ( I |u (X) I |dX dt < 
k«0 kt kx 

f' , tT X 

”2-/ 1 / u(x)dx J i 

k*0 \kx / 


(5.11) 


2 2 i i 2 

< C X u 


Hence, 


| |AGu| | < ct| | u| 


(5*12) 


This approach provides general but conservative stability condition 


a{i+j?G(jto)) > tc a(P(ja») 


(5.13) 


where constant C is defined by (5.12). This means that the curve G(l+PG(jw)) 
is to be compared with a certain level xcOP (jw) , as long as it is strictly 
above that level the system's stability with G replacing G is assured. 

In the next section we shall explore a particular three-dimensional 
single input-single output control system and this approach to the robustness 
problem will be applied. 
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whsre 



let this system represent the nominal dssign operator G discussed in 
previous section a with P* 1. Then 



A0 3 

For e wo can get a closed form expression (sine® A * 0) : 



fl 2 

- ~ +20 + 2 


( 6 . 6 ) 


(6.7) 


For the left hand part of the stability inequality (5.1) we have 
G ( j(0) « K(ljtU - A) * 



( 6 , 10 ) 


SO# 


G(jtt) - (1+ 2ja)-2W 2 )4r 

6T 


and 


0(1 + G(jW)) « jl + G(jto) | i 


|1 + 0<3 “’ 1 


( 6 . 11 ) 


The Pig. 22 shows the 0(w) 



In cd 


Fig. 22. Dependence £(M) . 

Since P * 1, the right hand part of the criterion (5.1) for this example 
is independent of to. We can rewrite the condition (5.1) in a form 

min |l + G(jOi) | > 0 

(t> 

with, as can be seen from the expression (6.11), 

min |l + G(jW) | * 1 (6.13) 

M 

According to (5.13), therefore, we have 
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1 


■t# 


l > a 9 t max S{0) «• 
<X0 <t 

9m 


(K 


X max 
(K0<t\ 


+ 20 R 


’) 



+ 2 % + 2 


j 


So, the stability condition is 



The critical value for t than ia 



+ 2T 


cr 



1 


X m 0,36 sac 
cr 


(6,14) 


(6,16) 


(6.1b) 


This number should be interpreted as a sample time T _ which is sufficiently 
small to guarantee stability of the control system when the continuous opera- 
tor G is replaced by an optimal hybrid approximation G. 

An implementation of the resulting closed loop control system is shown 
in Pig. 23. 

It is clear from this figure that 


y(t) - Ke A<t - kT) n 


where 


k 


\ - « 2J h 

4-1 


s 

£*1 


AT (k-Jl) p 

a S, 


and 


(6.17) 


(6.18) 
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I.C.* 0 at t*T(/-i) 


I.C, ot t*kr 



Fig. 23. Feedback Control System with Hybrid Operator 


Ax 

h- f 

(A-l)T 


(tA-0) 


Bu (6 ) d6 


(6.19) 


Hence we can rewrite (6.17) as 

VT 

Mt-t ) f , , 

y (t) = Ke K / e'** A, Bu(X)dX 


r 


(t-X) 


Bu (X ) dX 


( 6 . 20 ) 


The only difference between this expression and the continuous operator 
G is in integration limit. This indicates that G and G coincide exactly 
outside the "triangle strip" within which they hybrid operator equals to 
zero. This property has been discussed in Section 4. 

A discrete time equation for the closed loop beh<_>/ior of the approximated 
system in Fig. 23 can be written as follows: ^9 








AX * t* 

\ * Vi * 


-/ 


e AtTk-O) 0y (Q)dQ 


( 6 , 21 ) 


T(k-l) 


y(0) * Ke 


A(0-(k-l)T) 


n 


k-l 


Hence 


n. 


AT 


Tk 

/ •' 


(Tk-0) BKe A(0“<k-l)T) 


d0 


n 


k-l 


t ( k-l) 


(6.22) 


Therefore, the evolution of n k corresponds to discrete system with 
transition matrix 




» G 


AT 




(t ~ X) BKe AX dX 


(6.23) 


This matrix can be evaluated analytically in order to obtain its character- 
istic equation 



Eigenvalues of the matrix (6.24) have been computed for different T. 
Its values indicate that the system looses its stability when T = 0.54 sec. 
This compares quite favorably with the sufficient stability sound, 
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f 

i 


Prom the viewpoint oi! closed loop stability, the hybrid approximation 
G * G is not necessarily a good one. This is evident when we examine an 
alternate hybrid approximation which duplicates closed loop rather than open 
loop behavior outside the "triangle strip". This can be done by changing the 
hold device as follows t 



Pig. 24. Hold Device To Approximate Closed 

Loop System. 

Note that this "hold" generates exactly the same output signal y(t) as the 
continuous closed loop system under deterministic assumptions. This out- 
put is 



(6.25) 


In order to find a transition matrix of the corresponding discrete system, 
wo write 
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(6.26) 


Tk 


5 k“ / « A(Tk “ X) BK0 (A “ BK)X Vl dX 

x (k-1) 


n k * ^2 (,c)n k-l 


This leads to the transition matrix 

T 

i . . AT f A (T -X ) (A-BK)X . 

<P 2 (T) * e - J e BKe dX (6.27) 

0 

Using the identity IY A in the Appendix, (6.27) may be simplified to 

(T ) » e (A-BK) T (6.28) 

This result is natural because the system (6.25) was constructed to exhibit 
exactly the same closed loop behavior as the continuous one under determi- 
nistic assumptions. Therefore, this system must remain stable for all T. 

In order to compare performances of systems (6.17) and (6.25) in noisy 
situations, both approximations were examined for white noise inputs V(t) 
with intensity matrix 



(6.29) 


inserted at point in Fig . 23 . 

Convariance matrices of discrete systems (6.22) and (6.26) propogate 
according to the Lyapunov equation 

(6.30) 

= d) (T)p^ib (t) + x (T) 

k+1 1 k V 2 K 1 \r 1 
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where I^Or) is intensity matrix of noise accumulated on the sample interval 

T. 



(i) 

and where P^ denote the state covariance of the two systems 


p<i> 

k 




i a 1,2 


(6.32) 


Then, assuming steady state behavior of both systems we can solve 
matrix equation (6.30) to obtain P^ and P^. 


P (1) s ^(TjP^f^T) + I v (T) 

p (2) «<|> 2 <t> P ( 2 } 2 < T > + V T) 


(6.33) 
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(i) 


We used diagonal terms of the matrices P to compare systems per- 
formance. The results indicate that the first system (6.22) has a bettor 


performance 

(smaller variance of 

state variables) . 

It is shown 

in Fig. 

25, for values of pf^ 

jj 

and pfip 
D 1 

• 



p u 



P__ 

22 
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0.3292 
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2 9.101 . 10 -2 

0.3025 

0.3327 T*0. 2 sec 

0.3237 

0.8633 

5.062.10“ 

2 3.425.10’ 2 
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0.4579 T»0.4 sec 
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t 
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) 
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u 

O 

CM 

o 


Fig. 25. Comparison of Two Discrete Systems Performance 


This result may be interpreted in the following way. As we know from 
Section 4 the approximation used for the first system minimizes the cost 




54 


criterion (4.1) which minimizes mean square deviation between .»e outputs of 
the nominal and the hybrid system when they subjected to the same white 
noise process. Therefore, all other hybrid systems yield a greater value of 
cost function against this criterion. 


LIST OP USED SYMBOLS AND THEIR DIMENSIONS 


T,t,0 scalars 

k,& integer variables 

G (t, 0) t G(t, 0) - NxM matrices 


H(t) - NxK 

matrix 

H(t) - NXK 

matrix 

S(0), S(Q) - 

KxM matrices 

M(t) f M r - 

KxK matrices 

V (t ) , v k (t) - 

• N vectors 

u (0 ) - M 

vector 

£ (0 ) - LxN 

matrix 

h - 1 

vector 

d A - KXL 

matrix 

e R - L X XK 

matrix 

g(t) - NxL x 

matrix 

P - LxL 

matrix 

<j> A - KxL 

matrix 

\ - L i 

vector 

T - L l >CL 1 

matrix 

\ - V K 

matrix 

v - V L 

matrix 

B, - KxK 
k 

matrix 

- KxK 

matrix 

Ot f £ f Afj 

,r - scalar parameters 
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scalar parameters 


y(0) - scalar function 


A - NxN matrix 


p - LxM matrix 


3 - M vector 


Conclusions 


The general representation of the hybrid operator in a continuous time 
form is obtained in the first section of the thesis. 

Both lower and upper for the hybrid operator are established and their 
dependence on sampling interval e is clarified. Different types of sampling 
are discussed. 

A general approach for hybrid approximation of a continuous time in- 
variant multivariable systems is suggested with particular type of minimization 

ft 

criterion. This criterion is physically interpreted. Also some examples are 
considered in details. The formula for optimal computer coefficients is de- 
rived to provide a minimum value of criterion given fixed sampler and hold 
structures. This may lead to simplified analog circuits. Schemes for imple- 
mentation are drawn. 

A robustness problem for hybrid systems is formulated and investigated. 

A robustness condition for continuous systems is applied to the hybrid operator 
and the critical sampling interval value is found. This value guarantees the 
robustness of the hybrid approximating system. 

Ail these concepts and methods are illustrated on the three-dimensional 
control system. A numerical simulation has been performed and results in- 
terpreted. They indicate a consistency of the found critical value of sampling 
interval with its exact value. 

Directions for Further Investigation s 

1. In order to get a better understanding of processes in hybrid 
systems one would investigate how does the fixation of functions fg(X) and 
g Q (X) affect the quality of hybrid approximation and the robustness of the 
approximated system. 
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2. As mentioned in Section 4, th® bounding operator for pro- 
vides a rather conservative sufficient stability condition and# consequently# 
relatively small value of t . h better, less restrictive time invariant 
operator could be possibly found in order to obtain more precise value for 
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APPENDIX 


This Appendix bring* together soma mathematical formula* and thair 
derivation* which are used in variou* section* of the tha*i*. The include 
identities for matrix traces and thair derivatives* trace inequalities, 
inequalities for integrals and sums, one matrix identity used in the example. 

I, Differentiation of Traces. 

Identity* 

5g-tr[CE T TEj * 2TEC 00 

where C and T are square symmetric matrices. 

Proof s 

tr(CE T TE] *53 S (CET) ij (TE) ji " 

i j 

2 'sLj Xw Jw C ik E jk T jm E mi 
i j k m 

§1 trtCE TE] ■ ^ ^ y j ^ C ik T jml E jk^mp^iq + 

i j k m 

+ -L 

i j \ k 

C iq T jm E iui' S jp 
m 

■=E t 3pL v* 3* E^Evw ■ 

j k i m 
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+ E c i, ( ®’pi- 

i i 

* (CB T T) rt _ + (TEC) « (ETEC) 

<3P Pq Pq 

Corollary* 

tr[ETE T ] m 2ET 

Proofs put C*I and transpose both parts of the idenity (A) : 


tr(E TE) » 2E a T 
9e 


,T 


Call now E - E' , 


9e 


, tr(E'TE' T ] * 2E'T 


which proves (b) . 


Identity! 


^ tr[CE T i|>] * \l>c 


Proof: 


tr[CE T *l -SS'oEVld 
i j k 




(C) 


i j k 
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si- -LED«Wi« ■ 

Pq i $ H 

■EXv - <*=> Pq 

1 

II. properties of traces. 

A) tr(A+B) * tr(A) + fcr(B) 

B) tr(J*A(t)dt] - Jtr[A(t) Jdt 

C) tr (A) * tr (A T ) 

D) tr(A.B) £ tr (A) * tr (B) 

E) tr(A»B) m tr (B-A) 

Hare A and B are square matrices. 

III, Inequalities [6] 



IV. Matrix identity 

4>(T> . / e AtT-X) BK e<A- B K)X a ^ . 
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Proof; differentiate both parts with respect to T s 


a) left hand part 


■/ 


Ao AT - / Ae AW - X) BKe (A - BK,X d X - 


„„ (A-BK)T ___ (A-BK)T 

- BKe ■ A<p (X) - BKe 


b) right hand part 
(A-BK)o (R - BK,T 

If we now suppose 

... _ (A-BK)T 
9 (T ) = e 

then we come to the true equality 1=1. So, the formula (A) is proved. 
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